-- Logs begin at Wed 2022-06-22 08:02:26 UTC, end at Wed 2022-06-22 09:48:20 UTC. -- Jun 22 08:49:17.134265 dv-cinder-845990-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 22 08:49:17.141523 dv-cinder-845990-3-iscsi devstack@n-api.service[103447]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 22 08:49:17.143611 dv-cinder-845990-3-iscsi devstack@n-api.service[103447]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 22 08:49:17 2022] *** Jun 22 08:49:17.143611 dv-cinder-845990-3-iscsi devstack@n-api.service[103447]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 22 08:49:17.143611 dv-cinder-845990-3-iscsi devstack@n-api.service[103447]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 22 08:49:17.143611 dv-cinder-845990-3-iscsi devstack@n-api.service[103447]: nodename: dv-cinder-845990-3-iscsi Jun 22 08:49:17.143611 dv-cinder-845990-3-iscsi devstack@n-api.service[103447]: machine: x86_64 Jun 22 08:49:17.143611 dv-cinder-845990-3-iscsi devstack@n-api.service[103447]: clock source: unix Jun 22 08:49:17.143611 dv-cinder-845990-3-iscsi devstack@n-api.service[103447]: pcre jit disabled Jun 22 08:49:17.143611 dv-cinder-845990-3-iscsi devstack@n-api.service[103447]: detected number of CPU cores: 4 Jun 22 08:49:17.143611 dv-cinder-845990-3-iscsi devstack@n-api.service[103447]: current working directory: / Jun 22 08:49:17.143611 dv-cinder-845990-3-iscsi devstack@n-api.service[103447]: detected binary path: /usr/bin/uwsgi-core Jun 22 08:49:17.144323 dv-cinder-845990-3-iscsi devstack@n-api.service[103447]: your processes number limit is 47680 Jun 22 08:49:17.144323 dv-cinder-845990-3-iscsi devstack@n-api.service[103447]: your memory page size is 4096 bytes Jun 22 08:49:17.144323 dv-cinder-845990-3-iscsi devstack@n-api.service[103447]: detected max file descriptor number: 2048 Jun 22 08:49:17.144323 dv-cinder-845990-3-iscsi devstack@n-api.service[103447]: lock engine: pthread robust mutexes Jun 22 08:49:17.144323 dv-cinder-845990-3-iscsi devstack@n-api.service[103447]: thunder lock: enabled Jun 22 08:49:17.144323 dv-cinder-845990-3-iscsi devstack@n-api.service[103447]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 22 08:49:17.144323 dv-cinder-845990-3-iscsi devstack@n-api.service[103447]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 22 08:49:17.190367 dv-cinder-845990-3-iscsi devstack@n-api.service[103447]: Python main interpreter initialized at 0x5623a97339c0 Jun 22 08:49:17.190367 dv-cinder-845990-3-iscsi devstack@n-api.service[103447]: python threads support enabled Jun 22 08:49:17.190367 dv-cinder-845990-3-iscsi devstack@n-api.service[103447]: your server socket listen backlog is limited to 100 connections Jun 22 08:49:17.190367 dv-cinder-845990-3-iscsi devstack@n-api.service[103447]: your mercy for graceful operations on workers is 90 seconds Jun 22 08:49:17.190782 dv-cinder-845990-3-iscsi devstack@n-api.service[103447]: mapped 403077 bytes (393 KB) for 2 cores Jun 22 08:49:17.190912 dv-cinder-845990-3-iscsi devstack@n-api.service[103447]: *** Operational MODE: preforking *** Jun 22 08:49:17.191182 dv-cinder-845990-3-iscsi devstack@n-api.service[103447]: *** uWSGI is running in multiple interpreter mode *** Jun 22 08:49:17.191182 dv-cinder-845990-3-iscsi devstack@n-api.service[103447]: spawned uWSGI master process (pid: 103447) Jun 22 08:49:17.191385 dv-cinder-845990-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 22 08:49:17.192167 dv-cinder-845990-3-iscsi devstack@n-api.service[103447]: spawned uWSGI worker 1 (pid: 103448, cores: 1) Jun 22 08:49:17.192267 dv-cinder-845990-3-iscsi devstack@n-api.service[103447]: spawned uWSGI worker 2 (pid: 103449, cores: 1) Jun 22 08:49:17.192421 dv-cinder-845990-3-iscsi devstack@n-api.service[103447]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 22 08:49:17.867261 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 08:49:17.870981 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 08:49:18.999629 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 08:49:18.999629 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: from cryptography.utils import int_from_bytes Jun 22 08:49:19.000218 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 08:49:19.000218 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: from cryptography.utils import int_from_bytes Jun 22 08:49:19.003043 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 08:49:19.003043 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: from cryptography.utils import int_from_bytes Jun 22 08:49:19.003505 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 08:49:19.003505 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: from cryptography.utils import int_from_bytes Jun 22 08:49:21.481593 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 08:49:21.482118 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 08:49:21.482273 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 08:49:21.482626 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 08:49:21.482876 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 08:49:21.483259 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.483575 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.483889 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.483985 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 08:49:21.484333 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.484430 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 08:49:21.484518 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.484751 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 08:49:21.484880 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.485118 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.485213 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 08:49:21.485373 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 08:49:21.485459 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.485733 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.485824 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.486068 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.486169 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.486973 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.487077 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.487296 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845990-3-iscsi {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.487407 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.487614 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.487741 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.487917 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.488054 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.488227 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.488374 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.488538 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.488690 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.488867 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.489041 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.489183 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.489303 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.489480 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.489619 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.489942 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845990-3-iscsi {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.490034 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.490265 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.490417 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.490578 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.490704 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.490879 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.491008 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.491195 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.491414 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.491555 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.491686 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.491802 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.491929 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.492105 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.492241 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.492542 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.492634 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.492879 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.492982 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.493184 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.493293 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.493514 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.493616 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845990-3-iscsi {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.493846 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.493933 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.494156 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.494247 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.494458 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.494627 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.494775 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.494861 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.495079 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.495165 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.495397 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.495495 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.495700 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.495788 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.496047 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.496146 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845990-3-iscsi {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.496349 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.496443 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.496669 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.496764 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.497007 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.497094 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.497323 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.497419 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.497638 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.497734 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.497931 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.498026 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.498237 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.498323 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.498542 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.498629 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.498853 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.498939 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.499152 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.499244 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.499451 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.499545 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.499695 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.499872 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.499994 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.500118 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.500305 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.500404 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.500626 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.500760 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.501029 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.501135 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.501278 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.501402 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.501521 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.501704 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.501836 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.502029 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.502176 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.502476 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.502571 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.502774 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.502878 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.503074 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.503163 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.503371 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.503457 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.503671 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.503778 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.503966 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.504063 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.504245 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.504337 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.504549 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.504655 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.504886 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.504976 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.505194 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.505293 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.505499 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.505593 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.505799 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.505884 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.506106 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.506190 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.506407 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.506501 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.506706 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.506798 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.507006 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.507099 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.507305 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.507399 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.507621 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.507714 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.507924 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.508009 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.508240 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.508327 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.508544 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.508629 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.508864 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.508963 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.509168 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.509283 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.509470 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.509557 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.509782 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.509878 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.510113 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.510205 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.510410 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.510506 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.510654 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.510754 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.510947 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.511035 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.511242 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.511327 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.511554 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.511649 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.511852 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.511937 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.512150 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.512235 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.512446 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.512533 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.512740 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.512880 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.513061 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.513148 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.513360 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.513448 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.513673 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.513806 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.513952 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.514046 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.514247 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.514471 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.514560 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.514649 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.514825 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.514911 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.515120 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.515209 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.515414 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.515499 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.515714 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.515800 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.516020 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.516107 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.516315 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.516400 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.516611 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.516706 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.516931 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.517017 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.517226 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.517313 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.517543 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.517703 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.517847 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.517934 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.518204 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.518311 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.518458 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.518560 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.518773 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.518860 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.519074 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.519161 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.519374 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.519538 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.519673 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.519762 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.519970 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.520063 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.520281 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.520390 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.520575 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.520661 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.520896 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.520987 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.521208 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.521312 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.521509 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.521594 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.521802 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.521886 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.522097 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.522196 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.522392 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.522479 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.522685 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.522771 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.522979 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.523074 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.523273 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.523359 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.523567 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.523661 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.523857 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.523951 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.524164 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.524257 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.524466 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.524553 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.524764 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.524870 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.525083 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.525170 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.525379 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.525462 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.525675 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.525762 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.525979 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.526065 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.526277 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.526364 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.526572 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.526668 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.526885 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.526971 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.527200 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.527299 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.527506 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.527593 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.527811 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.527901 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.528115 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.528217 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.528429 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:49:21.528525 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.528745 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.528874 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.529074 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.529177 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.529378 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.529465 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.529681 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.529774 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.529991 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.530079 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.530299 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.530386 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.530620 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.530714 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.530930 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.531055 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.531239 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.531326 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.531547 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.531633 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.531852 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.531953 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.532155 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.532241 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.532461 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.532547 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.532772 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.532880 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.533098 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.533682 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.533947 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.534032 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.534263 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.534405 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.534575 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.534664 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.534888 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.534978 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.535194 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.535283 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.535496 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.535583 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.535801 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.535901 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.536104 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.536200 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.536419 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.536504 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.536742 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.536892 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.537068 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.537155 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.537379 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.537465 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.537684 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.537778 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.537987 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.538081 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.538289 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.538377 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.538593 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.538687 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.538894 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.538981 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.539208 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.539294 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.539513 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.539607 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.539821 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.539907 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.540124 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.540210 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.540431 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.540526 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.540731 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.540833 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.541058 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.541184 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.541355 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.541440 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.541641 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.541729 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.541937 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.542027 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.542234 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.542321 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.542536 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.542622 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.542831 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.542919 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.543141 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.543229 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.543445 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.543532 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.543742 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.543873 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.544046 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.544132 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.544349 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.544443 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.544649 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.544745 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.544975 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.545075 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.545277 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.545364 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.545575 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.545675 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.545876 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.545961 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.546178 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.546288 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.546475 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.546575 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.546793 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.546880 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.547096 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.547190 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.547395 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.547483 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.547698 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.547793 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.547996 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.548081 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.548296 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.548382 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.548602 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.548695 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.549535 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.549653 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.549844 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.549928 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.550152 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.550250 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.550456 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.550543 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.550775 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.550872 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.551084 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.551171 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.551391 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.551496 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.551700 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.551787 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.552014 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.552103 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.552318 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.552413 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.552622 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.552708 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.552954 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.553044 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.553264 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.553362 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.553562 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.553655 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.553866 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.554006 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.554165 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.554262 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.554462 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.554550 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.554758 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.554853 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.555062 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.555152 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.555358 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.555453 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.555655 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.555749 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.555950 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.556039 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.556247 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.556342 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.556541 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.556627 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.556878 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.556970 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.557183 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.557272 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.557479 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.557564 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.557773 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.557860 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.558068 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.558153 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.558368 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.558468 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.558666 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.558757 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.558963 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.559060 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.559261 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.559368 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.559580 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.559675 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.559885 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.559972 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.560187 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.560293 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.560484 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.560572 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.560809 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.560899 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.561113 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.561209 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.561419 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.561508 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.561722 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.561816 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.562032 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.562128 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.562336 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.562469 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.562646 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.562734 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.562948 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.563036 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.563263 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.563350 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.563564 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.563655 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.563867 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.563955 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.564162 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.564250 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.564511 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.564632 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.564960 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.565042 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.565299 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.565406 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.565614 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.565701 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.565921 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.566009 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.566248 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.566335 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.566556 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.566652 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.566863 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.566957 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.567162 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.567249 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.567460 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.567554 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.567761 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.567848 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.568072 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.568158 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.568375 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.568470 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.568691 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.568792 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.569029 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.569128 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.569337 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.569433 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.569634 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.569728 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.569938 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.570024 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.570234 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.570322 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.570541 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.570639 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.570863 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.570950 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.571189 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.571277 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.571491 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.571586 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.571795 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.571894 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.572111 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.572200 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.572414 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.572508 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.572717 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.572833 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.573046 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.573134 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.573342 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.573434 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.573638 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.573738 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.573941 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.574028 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.574248 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.574344 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.574548 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.574644 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.574849 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.574936 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.575146 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.575233 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.575450 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.575550 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.575750 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.575843 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.576048 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.576134 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.576342 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.576436 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.576645 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.576731 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.576980 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.577079 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.577280 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.577374 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.577584 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.577670 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.577887 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.577973 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.578182 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.578269 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.578483 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.578569 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.578783 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.578869 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.579084 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.579171 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.579380 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.579466 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.579674 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.579761 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.579967 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.580551 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.581064 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.581189 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.581280 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.581364 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.581471 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.581669 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.581754 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.581835 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.582038 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.582141 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.582347 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.582437 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.582652 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.582758 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.582951 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.583047 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.583250 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.583337 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.583565 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.583652 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.583870 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.583970 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.584169 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.584294 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.584470 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.584558 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.584772 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.584897 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.585095 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.585183 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.585399 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.585493 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.585701 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.585788 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.586004 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.586090 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.586306 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.586392 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.586607 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.586695 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.586903 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.586989 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.587202 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.587288 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.587506 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.587593 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.588091 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.588342 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.588436 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.588668 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.588764 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.589007 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.589110 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.589310 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.589405 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.589616 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.589706 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.589917 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.590004 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.590222 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.590309 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.590534 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.590623 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.590864 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.591091 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.591187 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.591418 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.591505 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.591733 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.591838 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.592026 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.592118 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.592331 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.592429 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.592628 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.592716 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.592951 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.593049 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.593247 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.593355 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.593550 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.593647 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.593846 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.593943 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.594144 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.594231 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.594442 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.594605 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.594741 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.594828 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.595046 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.595140 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.595344 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.595440 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.595657 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.596273 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.596494 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.596570 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.596838 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.596980 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.597145 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.597248 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.597443 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.597533 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.597740 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.597830 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.598038 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.598127 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.598345 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.598431 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.598646 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.598736 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.598956 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.599062 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.599256 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.599351 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.599575 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.599664 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.599885 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.599992 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.600183 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.600291 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.600478 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.600576 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.600813 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.600913 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.601098 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.601206 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.601396 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.601494 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.601698 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.601784 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.602001 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.602108 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.602296 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.602392 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.602600 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.602688 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.602903 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.603003 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.603204 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.603300 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.603506 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.603602 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.603800 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.603890 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.604099 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.604189 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.604395 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.604499 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.604698 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.604980 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.605092 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.605183 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.605306 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.605408 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.605602 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.605698 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.605905 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.605992 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.606202 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.606297 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.606498 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.606643 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.606799 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.606965 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.607094 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.607266 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.607403 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.607580 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.607700 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.607886 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.607980 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.608186 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.608276 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.608488 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.608576 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.608810 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.608903 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.609121 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.609221 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.609418 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.609516 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.609724 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.609814 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.610023 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.610113 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.610315 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.610402 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.610617 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.610718 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.610913 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.611000 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.611208 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.611333 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.611899 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.612005 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.612091 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.612180 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.612262 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.612342 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.612422 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.612645 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.612736 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.612984 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.613103 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.613290 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.613431 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.613580 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.613718 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.613881 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.614032 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.614169 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.614312 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.614477 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.614704 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.614841 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.614987 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.615132 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.615277 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.615414 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.615551 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.615687 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.615823 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.615966 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.616115 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.616270 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.616407 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.616543 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.616687 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.616849 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.616952 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.617072 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.617161 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.617373 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.617459 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.617694 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.617781 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.617996 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.618083 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.618297 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.618392 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.618596 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.618691 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.618903 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.618990 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.619206 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.619292 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.619503 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.619590 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.619795 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.619882 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.620091 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.620177 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.620390 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.620485 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.620694 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.620801 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.621014 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.621117 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.621311 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.621398 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.621624 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.621718 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.621926 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.622081 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.622229 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.622325 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.622542 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.622629 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.622855 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.623019 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.623142 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.623229 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.623452 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.623540 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.623751 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.623846 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.624050 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.624137 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.624348 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.624433 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.624645 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.624745 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.624972 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.625072 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.625275 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.625365 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.625581 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.625675 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.625883 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.625976 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.626184 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.626271 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.626488 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.626577 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.626786 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.626881 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.627208 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.627294 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.627610 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.627743 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.627918 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.628020 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.628227 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.628326 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.628535 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.628632 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.628875 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.628986 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.629182 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.629295 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.629484 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.629585 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.629784 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.629873 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.630081 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.630184 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.630410 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.630497 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.630719 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.630808 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.631026 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.631123 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.631329 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.631424 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.631653 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.631742 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.631955 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.632043 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.632257 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.632359 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.632562 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.632650 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.632883 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.632975 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.633196 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.633345 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.633486 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.633623 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.633873 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.634020 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.634158 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.634295 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.634456 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.634596 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.634742 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.634881 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.635044 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.635178 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.635339 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.635479 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.635623 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.635759 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.635906 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.636043 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.636200 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.636341 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.636516 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.636648 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.636834 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.636969 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.637151 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.637293 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.637555 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.637690 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.637857 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.637999 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.638136 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.638280 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.638445 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.638585 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.638765 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.638898 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.639067 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.639207 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.639368 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.639507 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.639668 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.639766 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.639988 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.640085 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.640290 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.640377 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.640609 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.640704 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.640934 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.641034 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.641253 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.641353 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.641575 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.641662 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.641901 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.642027 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.642197 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.642343 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.642496 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.643189 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.643520 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.643884 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.644209 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.644514 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.644847 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.644959 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.645159 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.645295 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.645481 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.645616 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.645806 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.645942 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.646116 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.646359 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.646455 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.646684 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.646772 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.646993 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.647080 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.647315 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.647405 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.647634 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.647720 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.647935 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.648021 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.648236 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.648352 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.648542 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.648674 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.648872 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.649008 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.649176 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.649329 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.649497 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.649650 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.649797 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.649955 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.650102 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.650257 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.650407 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.650567 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.650709 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.650869 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.651015 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.651171 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.651313 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.651496 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.651631 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.651800 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.651928 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.652108 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.652245 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.652420 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.652539 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.652726 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.652878 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.653051 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.653196 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.653353 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.653496 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.653679 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.653817 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.653979 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.654119 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.654301 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.654418 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.654613 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.654708 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.654933 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.655030 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.655251 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.655347 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.655555 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.655644 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.655876 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.655964 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.656182 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.656270 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.656483 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.656571 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.656801 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.656892 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.657110 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.657199 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.657449 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.657537 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.657757 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.657844 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.658074 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.658223 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.658980 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.659171 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.659242 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.659444 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.659554 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.659763 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.659885 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.660101 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.660204 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.660399 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.660497 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.660699 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.660820 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.661037 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.661134 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.661334 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.661423 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.661633 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.661719 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.661931 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.662026 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.662236 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.662323 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.662536 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.662624 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.662837 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.662924 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.663138 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.663235 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.663436 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.663521 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.663733 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.663864 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.664028 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.664130 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.664324 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.664417 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.664645 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.664741 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.664971 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.665073 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.665302 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.665436 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.665594 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.665690 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.665894 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.665981 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.666197 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.666293 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.666496 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.666591 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.666813 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.666905 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.667122 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.667214 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.667430 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.667517 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.667740 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.667826 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.668048 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.668136 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.668357 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.668445 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.668665 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.668759 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.668992 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.669080 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.669303 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.669392 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.669611 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.669697 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.669920 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.670007 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.670232 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.670443 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.670530 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.670764 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.670857 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.671077 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.671166 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.671383 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.671470 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.671687 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.671809 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.671993 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.672129 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.672299 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.672444 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.672603 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.672928 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.673030 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.673233 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.673328 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.673537 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.673632 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.673946 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.674052 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.674289 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.674505 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.674602 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.674782 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.674928 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.675094 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.675238 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.675403 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.675545 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.675711 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.675843 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.676020 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.676152 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.676327 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.676503 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.676652 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.676836 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.676996 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.677140 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.677320 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.677447 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.677655 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.677744 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.677972 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.678059 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.678285 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.678374 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.678597 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.678687 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.678909 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.678995 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.679212 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.679306 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.679515 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.679609 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.679819 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.679906 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.680124 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.680222 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.680428 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.680521 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.680737 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.680871 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.681068 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.681157 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.681376 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.681463 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.681682 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.681767 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.681988 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.682075 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.682295 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.682382 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.682599 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.682807 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.682911 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.683115 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.683204 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.683442 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.683528 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.683761 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.683856 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.684082 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.684169 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.684393 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.684494 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.684704 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.684813 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.685040 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.685137 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.685339 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.685558 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.685657 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.685871 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.685963 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.686202 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.686289 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.686499 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.686594 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.686814 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.686907 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.687116 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.687212 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.687411 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.687499 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.687723 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.687817 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.688024 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.688110 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.688323 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.688552 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.688639 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.688923 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.689014 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.689238 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.689342 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.689582 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.689670 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.689902 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.689995 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.690216 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.690323 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.690517 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.690605 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.690844 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.690932 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.691146 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.691391 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.691491 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.691737 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.691835 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.692040 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.692133 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.692339 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.692425 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.692636 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.692722 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.692972 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.693109 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.693274 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.693366 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.693571 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.693669 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.693873 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.693975 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.694172 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.694271 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.694480 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.694567 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.694777 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.694865 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.695075 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.695162 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.695373 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.695460 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.695679 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.695825 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.695978 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.696116 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.696260 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.696402 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.696550 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.696686 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.696855 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.696941 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.697162 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.697248 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.697460 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.697548 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.697761 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.697848 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.698058 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.698157 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.698359 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.698458 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.698653 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.698748 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.698950 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.699044 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.699250 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.699343 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.699548 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.699634 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.699855 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.699959 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.700155 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.700285 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.700460 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.700546 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.700757 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.700926 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.701085 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.701173 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.701385 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.701478 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.701685 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.701772 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.702025 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.702111 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.702333 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.702420 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.702631 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.702855 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.702950 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.703183 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.703271 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.703496 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.703592 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.703821 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.703909 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.704129 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.704214 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.704433 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.704535 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.704729 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.704835 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.705598 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.705708 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.705993 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.706285 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.706371 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.706600 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.706686 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.706908 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.707006 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.707216 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.707304 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.707521 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.707607 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.707824 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.707985 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.708129 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.708217 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.708434 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.708528 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.708735 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.708873 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.709063 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.709150 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.709366 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.709452 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.709669 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.709765 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.709971 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.710059 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.710275 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.710405 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.710583 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.710679 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.710891 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.710978 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.711197 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.711284 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.711503 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.711598 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.711807 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.711893 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.712107 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.712205 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.712409 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.712495 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.712988 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.713082 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.713303 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.713408 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.713613 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.713700 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.713934 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.714022 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.714242 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.714337 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.714555 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.714651 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.714852 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.714938 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.715159 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.715247 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.715467 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.715554 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.715774 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.715861 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.716082 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.716179 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.716392 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.716485 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.716719 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.716826 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.717053 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.717148 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.717355 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.717442 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.717694 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.717987 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.718101 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.718319 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.718424 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.718641 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.718734 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.718961 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.719051 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.719261 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.719349 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.719560 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.719655 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.719857 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.719960 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.720164 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.720268 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.720474 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.720571 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.721382 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.721495 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.721689 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.721779 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.721988 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.722085 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.722292 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.722380 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.722589 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.722682 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.722887 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.722983 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.723186 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.723320 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.723481 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.723568 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.723784 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.723884 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.724080 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.724167 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.724376 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.724468 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.724673 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.724769 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.725001 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.725089 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.725298 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.725384 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.725593 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.725690 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.725896 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.725981 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.726191 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.726278 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.726487 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.726582 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.726782 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.726868 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.727081 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.727166 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.727374 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.727505 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.727724 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.727824 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.727965 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.728061 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.728267 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.728354 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.728568 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.728654 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.728898 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.729003 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.729201 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.729297 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.729502 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.729589 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.729802 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.729897 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.730104 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.730193 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.730404 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.730502 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.730714 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.730811 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.731039 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.731126 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.731350 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.731436 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.731700 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.731795 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.731958 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.732045 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.732261 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.732355 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.732564 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.732652 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.732889 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.732978 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.733209 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.733306 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.733521 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.733608 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.733820 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.733905 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.734138 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.734234 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.734443 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.734541 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.734754 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.734849 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.735059 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.735153 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.735365 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.735452 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.735669 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.735755 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.735979 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.736079 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.736296 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.736389 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.736674 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.736762 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.737009 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.737106 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.737317 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.737405 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.737629 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.737723 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.737942 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.738030 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.738253 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.738346 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.738563 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.738651 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.738868 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.738954 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.739184 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.739277 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.739492 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.739579 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.739804 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.739892 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.740112 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.740204 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.740418 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.740513 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.740729 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.740835 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.741065 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.741164 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.741387 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.741483 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.741688 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.741774 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.741928 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 08:49:21.742062 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.742318 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.742643 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.742990 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.743299 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.743641 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.743974 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.744289 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.744599 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.744931 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:49:21.745173 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 08:49:21.896009 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO dbcounter [None req-0bbc76c7-4aca-47d3-98a0-1a491430b83a None None] Registered counter for database nova_api Jun 22 08:49:21.899059 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO dbcounter [None req-9702db24-6525-4aa3-ac46-6f1977935a09 None None] Registered counter for database nova_api Jun 22 08:49:21.917234 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG oslo_db.sqlalchemy.engines [None req-0bbc76c7-4aca-47d3-98a0-1a491430b83a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:49:21.919342 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG oslo_db.sqlalchemy.engines [None req-9702db24-6525-4aa3-ac46-6f1977935a09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103448) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:49:21.924423 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG dbcounter [-] [103449] Writer thread running {{(pid=103449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:49:21.926370 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG dbcounter [-] [103448] Writer thread running {{(pid=103448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:49:21.983083 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.context [None req-0bbc76c7-4aca-47d3-98a0-1a491430b83a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5ad901b7-3900-406f-b273-6ca9cc1c0d47(cell1) {{(pid=103449) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 08:49:21.983688 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.context [None req-9702db24-6525-4aa3-ac46-6f1977935a09 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5ad901b7-3900-406f-b273-6ca9cc1c0d47(cell1) {{(pid=103448) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 08:49:21.987727 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG oslo_concurrency.lockutils [None req-0bbc76c7-4aca-47d3-98a0-1a491430b83a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:49:21.988249 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG oslo_concurrency.lockutils [None req-9702db24-6525-4aa3-ac46-6f1977935a09 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:49:21.989315 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG oslo_concurrency.lockutils [None req-0bbc76c7-4aca-47d3-98a0-1a491430b83a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:49:21.989848 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG oslo_concurrency.lockutils [None req-9702db24-6525-4aa3-ac46-6f1977935a09 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:49:21.990108 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG oslo_concurrency.lockutils [None req-0bbc76c7-4aca-47d3-98a0-1a491430b83a None None] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:49:21.990617 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG oslo_concurrency.lockutils [None req-9702db24-6525-4aa3-ac46-6f1977935a09 None None] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:49:21.992048 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG oslo_concurrency.lockutils [None req-0bbc76c7-4aca-47d3-98a0-1a491430b83a None None] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:49:21.992534 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG oslo_concurrency.lockutils [None req-9702db24-6525-4aa3-ac46-6f1977935a09 None None] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:49:21.994035 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO dbcounter [None req-0bbc76c7-4aca-47d3-98a0-1a491430b83a None None] Registered counter for database nova_cell0 Jun 22 08:49:21.994503 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO dbcounter [None req-9702db24-6525-4aa3-ac46-6f1977935a09 None None] Registered counter for database nova_cell0 Jun 22 08:49:21.998041 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO dbcounter [None req-0bbc76c7-4aca-47d3-98a0-1a491430b83a None None] Registered counter for database nova_cell1 Jun 22 08:49:21.998505 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO dbcounter [None req-9702db24-6525-4aa3-ac46-6f1977935a09 None None] Registered counter for database nova_cell1 Jun 22 08:49:22.005546 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG oslo_db.sqlalchemy.engines [None req-0bbc76c7-4aca-47d3-98a0-1a491430b83a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:49:22.007043 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG oslo_db.sqlalchemy.engines [None req-9702db24-6525-4aa3-ac46-6f1977935a09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103448) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:49:22.009248 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG oslo_db.sqlalchemy.engines [None req-9702db24-6525-4aa3-ac46-6f1977935a09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103448) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:49:22.011635 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG oslo_db.sqlalchemy.engines [None req-0bbc76c7-4aca-47d3-98a0-1a491430b83a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:49:22.014267 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG dbcounter [-] [103448] Writer thread running {{(pid=103448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:49:22.014556 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG dbcounter [-] [103449] Writer thread running {{(pid=103449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:49:22.016901 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG dbcounter [-] [103448] Writer thread running {{(pid=103448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:49:22.154165 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG dbcounter [-] [103449] Writer thread running {{(pid=103449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:49:22.161995 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO dbcounter [None req-9702db24-6525-4aa3-ac46-6f1977935a09 None None] Registered counter for database nova_cell0 Jun 22 08:49:22.164447 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO dbcounter [None req-0bbc76c7-4aca-47d3-98a0-1a491430b83a None None] Registered counter for database nova_cell0 Jun 22 08:49:22.170758 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG oslo_db.sqlalchemy.engines [None req-9702db24-6525-4aa3-ac46-6f1977935a09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103448) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:49:22.174378 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG oslo_db.sqlalchemy.engines [None req-0bbc76c7-4aca-47d3-98a0-1a491430b83a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:49:22.175349 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG dbcounter [-] [103448] Writer thread running {{(pid=103448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:49:22.178855 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG dbcounter [-] [103449] Writer thread running {{(pid=103449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:49:22.589399 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: WARNING keystonemiddleware.auth_token [None req-9702db24-6525-4aa3-ac46-6f1977935a09 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 08:49:22.596799 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: WARNING keystonemiddleware.auth_token [None req-9702db24-6525-4aa3-ac46-6f1977935a09 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 08:49:22.616323 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: WARNING keystonemiddleware.auth_token [None req-0bbc76c7-4aca-47d3-98a0-1a491430b83a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 08:49:22.625175 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: WARNING keystonemiddleware.auth_token [None req-0bbc76c7-4aca-47d3-98a0-1a491430b83a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 08:49:22.936269 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: WARNING keystonemiddleware.auth_token [None req-9702db24-6525-4aa3-ac46-6f1977935a09 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 08:49:22.942351 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: WARNING keystonemiddleware.auth_token [None req-9702db24-6525-4aa3-ac46-6f1977935a09 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 08:49:22.947569 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5623a97339c0 pid: 103448 (default app) Jun 22 08:49:22.949655 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-9702db24-6525-4aa3-ac46-6f1977935a09 None None] Calling method '>' {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:49:22.950838 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-9702db24-6525-4aa3-ac46-6f1977935a09 None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001755 Jun 22 08:49:22.951240 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Wed Jun 22 08:49:22 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:49:22.971925 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: WARNING keystonemiddleware.auth_token [None req-0bbc76c7-4aca-47d3-98a0-1a491430b83a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 08:49:22.978100 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: WARNING keystonemiddleware.auth_token [None req-0bbc76c7-4aca-47d3-98a0-1a491430b83a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 08:49:22.989634 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5623a97339c0 pid: 103449 (default app) Jun 22 08:50:40.741766 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-9702db24-6525-4aa3-ac46-6f1977935a09 None None] Calling method '>' {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:50:40.742755 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-9702db24-6525-4aa3-ac46-6f1977935a09 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jun 22 08:50:40.743151 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 930 bytes} [Wed Jun 22 08:50:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:50:40.756393 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG dbcounter [-] [103449] Writing DB stats nova_api:SELECT=3 {{(pid=103449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:40.757370 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG dbcounter [-] [103449] Writing DB stats nova_cell1:SELECT=3 {{(pid=103449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:40.758310 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG dbcounter [-] [103449] Writing DB stats nova_cell0:SELECT=3 {{(pid=103449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:40.759612 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG dbcounter [-] [103449] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:41.201035 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-970eef2a-f5cc-4806-b942-57c20e798c25 admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:50:41.233073 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-970eef2a-f5cc-4806-b942-57c20e798c25 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.482723 Jun 22 08:50:41.233800 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1291 bytes} [Wed Jun 22 08:50:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:50:43.332727 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-9702db24-6525-4aa3-ac46-6f1977935a09 None None] Calling method '>' {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:50:43.333838 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-9702db24-6525-4aa3-ac46-6f1977935a09 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Jun 22 08:50:43.334249 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 3/4] 10.222.0.16 () {54 vars in 930 bytes} [Wed Jun 22 08:50:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:50:43.396192 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-ac9854a4-1d46-4564-9b7c-3547dcd3013d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "os-flavor-access:is_public": true, "vcpus": 1, "disk": 1, "ram": 256, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "swap": 0}} {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:50:43.414202 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:50:43.414202 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: warnings.warn(msg) Jun 22 08:50:43.534370 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-ac9854a4-1d46-4564-9b7c-3547dcd3013d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.193702 Jun 22 08:50:43.535067 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 2/5] 10.222.0.16 () {64 vars in 1282 bytes} [Wed Jun 22 08:50:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 08:50:43.549819 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG dbcounter [-] [103448] Writing DB stats nova_api:SELECT=3 {{(pid=103448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:43.550895 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG dbcounter [-] [103448] Writing DB stats nova_cell1:SELECT=3 {{(pid=103448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:43.552508 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG dbcounter [-] [103448] Writing DB stats nova_cell0:SELECT=3 {{(pid=103448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:43.553648 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG dbcounter [-] [103448] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:43.763871 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-56a37e9d-d5df-45ec-8f24-00853fec7f4a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:50:43.766304 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:50:43.766304 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: warnings.warn(msg) Jun 22 08:50:43.874154 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-56a37e9d-d5df-45ec-8f24-00853fec7f4a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.330411 Jun 22 08:50:43.878116 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 4/6] 10.222.0.16 () {64 vars in 1335 bytes} [Wed Jun 22 08:50:43 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:50:45.963862 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-ac9854a4-1d46-4564-9b7c-3547dcd3013d admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:50:45.964899 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-ac9854a4-1d46-4564-9b7c-3547dcd3013d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 22 08:50:45.965313 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 3/7] 10.222.0.16 () {54 vars in 930 bytes} [Wed Jun 22 08:50:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:50:46.071604 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-4c022573-101f-414b-a3af-0c1ca23388ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 512, "name": "ds512M", "os-flavor-access:is_public": true, "id": "d1", "vcpus": 1}} {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:50:46.090445 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:50:46.090445 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: warnings.warn(msg) Jun 22 08:50:46.171028 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-4c022573-101f-414b-a3af-0c1ca23388ad admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.199302 Jun 22 08:50:46.171628 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 5/8] 10.222.0.16 () {64 vars in 1282 bytes} [Wed Jun 22 08:50:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 08:50:46.183165 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-2683e0c1-a784-42a5-88d9-642bded47c88 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:50:46.184672 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:50:46.184672 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: warnings.warn(msg) Jun 22 08:50:46.287521 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-2683e0c1-a784-42a5-88d9-642bded47c88 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108054 Jun 22 08:50:46.288142 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 4/9] 10.222.0.16 () {64 vars in 1335 bytes} [Wed Jun 22 08:50:46 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:50:48.370835 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-4c022573-101f-414b-a3af-0c1ca23388ad admin admin] Calling method '>' {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:50:48.371831 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-4c022573-101f-414b-a3af-0c1ca23388ad admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 22 08:50:48.372392 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 930 bytes} [Wed Jun 22 08:50:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 08:50:48.439324 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-3b1a1883-db67-43ed-add8-ff227c102818 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d2", "swap": 0, "ram": 1024, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:50:48.518539 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-3b1a1883-db67-43ed-add8-ff227c102818 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.139714 Jun 22 08:50:48.519104 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 5/11] 10.222.0.16 () {64 vars in 1282 bytes} [Wed Jun 22 08:50:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 08:50:48.531000 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-1434e45c-95e8-4892-a368-58b27d01d263 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:50:48.607870 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-1434e45c-95e8-4892-a368-58b27d01d263 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080659 Jun 22 08:50:48.616824 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 7/12] 10.222.0.16 () {64 vars in 1335 bytes} [Wed Jun 22 08:50:48 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:50:50.694517 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-3b1a1883-db67-43ed-add8-ff227c102818 admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:50:50.695518 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-3b1a1883-db67-43ed-add8-ff227c102818 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jun 22 08:50:50.695923 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 6/13] 10.222.0.16 () {54 vars in 930 bytes} [Wed Jun 22 08:50:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:50:50.754584 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-0ee34fe3-1281-46e5-aff9-f9fc1c42fc58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 2, "id": "d3", "disk": 10, "swap": 0}} {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:50:50.808512 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-0ee34fe3-1281-46e5-aff9-f9fc1c42fc58 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.107008 Jun 22 08:50:50.809199 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 8/14] 10.222.0.16 () {64 vars in 1282 bytes} [Wed Jun 22 08:50:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 08:50:50.821255 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-23094be9-66b9-496c-bbd4-01f5380b333c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:50:50.893363 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-23094be9-66b9-496c-bbd4-01f5380b333c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075705 Jun 22 08:50:50.893871 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 7/15] 10.222.0.16 () {64 vars in 1335 bytes} [Wed Jun 22 08:50:50 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:50:52.995260 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-0ee34fe3-1281-46e5-aff9-f9fc1c42fc58 admin admin] Calling method '>' {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:50:52.996983 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-0ee34fe3-1281-46e5-aff9-f9fc1c42fc58 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002060 Jun 22 08:50:53.002959 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 9/16] 10.222.0.16 () {54 vars in 930 bytes} [Wed Jun 22 08:50:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:50:53.082555 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-e5350152-7c15-4e4b-82d3-eb35a6eb7d02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "swap": 0, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "vcpus": 4, "rxtx_factor": 1.0, "disk": 20}} {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:50:53.175334 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-e5350152-7c15-4e4b-82d3-eb35a6eb7d02 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.170652 Jun 22 08:50:53.175803 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 8/17] 10.222.0.16 () {64 vars in 1282 bytes} [Wed Jun 22 08:50:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 08:50:53.190160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-e471dc53-e1bf-43db-9b5a-7574aa7d50d8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:50:53.304931 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-e471dc53-e1bf-43db-9b5a-7574aa7d50d8 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118756 Jun 22 08:50:53.305504 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 10/18] 10.222.0.16 () {64 vars in 1335 bytes} [Wed Jun 22 08:50:53 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:50:55.399918 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-e5350152-7c15-4e4b-82d3-eb35a6eb7d02 admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:50:55.401130 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-e5350152-7c15-4e4b-82d3-eb35a6eb7d02 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001877 Jun 22 08:50:55.401827 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 9/19] 10.222.0.16 () {54 vars in 930 bytes} [Wed Jun 22 08:50:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:50:55.466000 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-dd6a5ff9-fc20-4b85-893c-4bf40222b58e admin admin] Calling method '>' {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:50:55.490289 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-dd6a5ff9-fc20-4b85-893c-4bf40222b58e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081972 Jun 22 08:50:55.491065 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 11/20] 10.222.0.16 () {60 vars in 1291 bytes} [Wed Jun 22 08:50:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 08:50:57.662358 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-e5350152-7c15-4e4b-82d3-eb35a6eb7d02 admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:50:57.663358 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-e5350152-7c15-4e4b-82d3-eb35a6eb7d02 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jun 22 08:50:57.663759 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 10/21] 10.222.0.16 () {54 vars in 930 bytes} [Wed Jun 22 08:50:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:50:57.726209 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-76a0fdeb-6ba2-4522-9ee1-cd3c891dbac6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 512, "name": "m1.tiny", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:50:57.815821 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-76a0fdeb-6ba2-4522-9ee1-cd3c891dbac6 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.146300 Jun 22 08:50:57.816373 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 12/22] 10.222.0.16 () {64 vars in 1282 bytes} [Wed Jun 22 08:50:57 2022] POST /compute/v2.1/flavors => generated 402 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 08:50:57.829088 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-c0f9dc3e-b995-4fb3-bc74-601dfc8a411d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:50:57.900245 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-c0f9dc3e-b995-4fb3-bc74-601dfc8a411d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075506 Jun 22 08:50:57.901242 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 11/23] 10.222.0.16 () {64 vars in 1332 bytes} [Wed Jun 22 08:50:57 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:51:00.032400 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-76a0fdeb-6ba2-4522-9ee1-cd3c891dbac6 admin admin] Calling method '>' {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:51:00.033458 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-76a0fdeb-6ba2-4522-9ee1-cd3c891dbac6 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Jun 22 08:51:00.033855 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 930 bytes} [Wed Jun 22 08:51:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:51:00.097842 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-d7ee0b16-2344-4d12-b167-5e8cff8b1f14 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "disk": 20, "ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "id": "2", "os-flavor-access:is_public": true}} {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:51:00.181496 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-d7ee0b16-2344-4d12-b167-5e8cff8b1f14 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.141775 Jun 22 08:51:00.182042 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 12/25] 10.222.0.16 () {64 vars in 1282 bytes} [Wed Jun 22 08:51:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 08:51:00.194504 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-e642bb79-fc80-4318-9007-80a3dda6945d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:51:00.287952 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-e642bb79-fc80-4318-9007-80a3dda6945d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097191 Jun 22 08:51:00.288773 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 14/26] 10.222.0.16 () {64 vars in 1332 bytes} [Wed Jun 22 08:51:00 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:51:02.689010 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-d7ee0b16-2344-4d12-b167-5e8cff8b1f14 admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:51:02.690007 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-d7ee0b16-2344-4d12-b167-5e8cff8b1f14 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jun 22 08:51:02.690407 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 930 bytes} [Wed Jun 22 08:51:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 08:51:02.749874 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-c445d4e7-8978-44e0-bbc0-88a43e98bf58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "id": "3", "ram": 4096, "os-flavor-access:is_public": true, "disk": 40, "swap": 0, "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:51:02.819799 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-c445d4e7-8978-44e0-bbc0-88a43e98bf58 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.123462 Jun 22 08:51:02.820347 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 15/28] 10.222.0.16 () {64 vars in 1282 bytes} [Wed Jun 22 08:51:02 2022] POST /compute/v2.1/flavors => generated 406 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 08:51:02.833076 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-8e8e3bac-b1cb-484a-908b-25aa8a59ab6d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:51:02.910981 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-8e8e3bac-b1cb-484a-908b-25aa8a59ab6d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081538 Jun 22 08:51:02.911483 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 14/29] 10.222.0.16 () {64 vars in 1332 bytes} [Wed Jun 22 08:51:02 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:51:04.971611 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-c445d4e7-8978-44e0-bbc0-88a43e98bf58 admin admin] Calling method '>' {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:51:04.972617 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-c445d4e7-8978-44e0-bbc0-88a43e98bf58 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jun 22 08:51:04.973054 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 930 bytes} [Wed Jun 22 08:51:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:51:05.032336 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-b7fe3319-e6f2-4465-99f9-30c5d5ac39b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "swap": 0, "os-flavor-access:is_public": true, "ram": 8192, "vcpus": 4, "name": "m1.large", "rxtx_factor": 1.0, "disk": 80}} {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:51:05.111557 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-b7fe3319-e6f2-4465-99f9-30c5d5ac39b9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.132730 Jun 22 08:51:05.112172 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 15/31] 10.222.0.16 () {64 vars in 1282 bytes} [Wed Jun 22 08:51:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 08:51:05.124029 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-375c86c1-8042-4123-b837-f9e501637998 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:51:05.212966 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-375c86c1-8042-4123-b837-f9e501637998 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092350 Jun 22 08:51:05.216827 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 17/32] 10.222.0.16 () {64 vars in 1332 bytes} [Wed Jun 22 08:51:05 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:51:07.314859 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-b7fe3319-e6f2-4465-99f9-30c5d5ac39b9 admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:51:07.316572 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-b7fe3319-e6f2-4465-99f9-30c5d5ac39b9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002146 Jun 22 08:51:07.321092 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 930 bytes} [Wed Jun 22 08:51:07 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:51:07.382591 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-6d5ca1e1-4f9a-4994-8b6f-3fd355eb5d7c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "id": "5", "name": "m1.xlarge", "swap": 0, "rxtx_factor": 1.0, "disk": 160, "os-flavor-access:is_public": true, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:51:07.455018 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-6d5ca1e1-4f9a-4994-8b6f-3fd355eb5d7c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.131603 Jun 22 08:51:07.455835 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 18/34] 10.222.0.16 () {64 vars in 1282 bytes} [Wed Jun 22 08:51:07 2022] POST /compute/v2.1/flavors => generated 408 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 08:51:07.471299 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-a8133251-a9bc-477b-836e-bbb1670c8307 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:51:07.537932 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-a8133251-a9bc-477b-836e-bbb1670c8307 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073469 Jun 22 08:51:07.538790 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 17/35] 10.222.0.16 () {64 vars in 1332 bytes} [Wed Jun 22 08:51:07 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:51:32.567777 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-6d5ca1e1-4f9a-4994-8b6f-3fd355eb5d7c admin admin] Calling method '>' {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:51:32.568768 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-6d5ca1e1-4f9a-4994-8b6f-3fd355eb5d7c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jun 22 08:51:32.569183 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 930 bytes} [Wed Jun 22 08:51:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:51:32.579593 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG dbcounter [-] [103449] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:51:32.627964 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-ac4df085-9ee7-42c4-9870-0161935c9116 admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:51:32.644533 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-ac4df085-9ee7-42c4-9870-0161935c9116 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069441 Jun 22 08:51:32.645091 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1291 bytes} [Wed Jun 22 08:51:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:51:33.561343 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-6d5ca1e1-4f9a-4994-8b6f-3fd355eb5d7c admin admin] Calling method '>' {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:51:33.562413 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-6d5ca1e1-4f9a-4994-8b6f-3fd355eb5d7c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jun 22 08:51:33.562911 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Jun 22 08:51:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:51:33.752093 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-fad9d42e-7b3a-410a-9a8c-a5302cbac145 admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:51:33.757907 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.wsgi [None req-fad9d42e-7b3a-410a-9a8c-a5302cbac145 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 22 08:51:33.761241 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-fad9d42e-7b3a-410a-9a8c-a5302cbac145 admin admin] Request method failure captured: Jun 22 08:51:33.761241 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 22 08:51:33.761241 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: Accept: application/json Jun 22 08:51:33.761241 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: Accept-Encoding: gzip, deflate Jun 22 08:51:33.761241 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: Connection: keep-alive Jun 22 08:51:33.761241 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: Content-Length: 0 Jun 22 08:51:33.761241 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: Host: 10.222.0.16 Jun 22 08:51:33.761241 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: Openstack-Api-Version: compute 2.90 Jun 22 08:51:33.761241 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: Openstack-System-Scope: None Jun 22 08:51:33.761241 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: User-Agent: python-novaclient Jun 22 08:51:33.761241 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Auth-Token: gAAAAABistgVlY67oZTyvrudFkisQ_GifgtNLlxI2YtiHqXDOoQA9NlAnesRwS5P8WYjzwg-tME04h7_ZhIXeYYRmHFCYA401OrogX2vuemY13aJm0eqRxjFlaVWxr-wHBlQVUmMtj7P24atRSdIbS2jEAINguvf7hWl3O0M_L_6gbCfPcvouMU Jun 22 08:51:33.761241 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Domain-Id: None Jun 22 08:51:33.761241 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Domain-Name: None Jun 22 08:51:33.761241 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Identity-Status: Confirmed Jun 22 08:51:33.761241 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Is-Admin-Project: True Jun 22 08:51:33.761241 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 08:51:33.761241 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Project-Domain-Id: default Jun 22 08:51:33.761241 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Project-Domain-Name: Default Jun 22 08:51:33.761241 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Project-Id: f402cbaaeeca4e1986ebe320dcfedbb1 Jun 22 08:51:33.761241 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Project-Name: admin Jun 22 08:51:33.761241 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Role: member,reader,admin Jun 22 08:51:33.761241 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Roles: member,reader,admin Jun 22 08:51:33.762888 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f402cbaaeeca4e1986ebe320dcfedbb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f402cbaaeeca4e1986ebe320dcfedbb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f402cbaaeeca4e1986ebe320dcfedbb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f402cbaaeeca4e1986ebe320dcfedbb1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 08:51:33.762888 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Tenant: admin Jun 22 08:51:33.762888 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Tenant-Id: f402cbaaeeca4e1986ebe320dcfedbb1 Jun 22 08:51:33.762888 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Tenant-Name: admin Jun 22 08:51:33.762888 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-User: admin Jun 22 08:51:33.762888 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-User-Domain-Id: default Jun 22 08:51:33.762888 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-User-Domain-Name: Default Jun 22 08:51:33.762888 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-User-Id: f02f025a6a5540ff82662f286ae57c54 Jun 22 08:51:33.762888 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-User-Name: admin Jun 22 08:51:33.762888 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: method: > Jun 22 08:51:33.762888 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: exception: Flavor 42 could not be found. Jun 22 08:51:33.762888 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: action_args: {'id': '42'} Jun 22 08:51:33.762888 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 08:51:33.762888 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:51:33.764909 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 08:51:33.764909 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 08:51:33.764909 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 08:51:33.764909 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 08:51:33.764909 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 08:51:33.764909 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 08:51:33.764909 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 08:51:33.764909 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 08:51:33.764909 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 08:51:33.764909 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 08:51:33.764909 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 08:51:33.764909 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 08:51:33.764909 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 22 08:51:33.764909 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Jun 22 08:51:33.764909 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 08:51:33.764909 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Jun 22 08:51:33.764909 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:51:33.764909 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 08:51:33.764909 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 08:51:33.766299 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 08:51:33.766299 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 08:51:33.766299 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 08:51:33.766299 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 08:51:33.766299 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 08:51:33.766299 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 08:51:33.766299 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 22 08:51:33.766299 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Jun 22 08:51:33.766299 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 08:51:33.766299 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Jun 22 08:51:33.766299 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:51:33.766299 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 08:51:33.766299 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 08:51:33.766299 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 08:51:33.766299 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 08:51:33.766299 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 22 08:51:33.766299 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Jun 22 08:51:33.766299 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-fad9d42e-7b3a-410a-9a8c-a5302cbac145 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 08:51:33.767640 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-fad9d42e-7b3a-410a-9a8c-a5302cbac145 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062253 Jun 22 08:51:33.767640 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1190 bytes} [Wed Jun 22 08:51:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 08:51:33.772770 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-356a143e-0ddd-432e-a3d0-2e76415061d0 admin admin] Calling method '>' {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:51:33.775652 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG dbcounter [-] [103448] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:51:33.794443 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-356a143e-0ddd-432e-a3d0-2e76415061d0 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025363 Jun 22 08:51:33.795055 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Jun 22 08:51:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:51:33.804645 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-cbc47685-7862-4f08-bc07-4a4c47fbcbdd admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:51:33.827283 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-cbc47685-7862-4f08-bc07-4a4c47fbcbdd admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026114 Jun 22 08:51:33.827802 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Jun 22 08:51:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 08:51:33.837161 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-79d02ad8-38df-4c5e-9b6a-eb9e3d027502 admin admin] Calling method '>' {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:51:33.843893 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.wsgi [None req-79d02ad8-38df-4c5e-9b6a-eb9e3d027502 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 22 08:51:33.847160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-79d02ad8-38df-4c5e-9b6a-eb9e3d027502 admin admin] Request method failure captured: Jun 22 08:51:33.847160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 22 08:51:33.847160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: Accept: application/json Jun 22 08:51:33.847160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: Accept-Encoding: gzip, deflate Jun 22 08:51:33.847160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: Connection: keep-alive Jun 22 08:51:33.847160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: Content-Length: 0 Jun 22 08:51:33.847160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: Host: 10.222.0.16 Jun 22 08:51:33.847160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: Openstack-Api-Version: compute 2.90 Jun 22 08:51:33.847160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: Openstack-System-Scope: None Jun 22 08:51:33.847160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: User-Agent: python-novaclient Jun 22 08:51:33.847160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Auth-Token: gAAAAABistgVlY67oZTyvrudFkisQ_GifgtNLlxI2YtiHqXDOoQA9NlAnesRwS5P8WYjzwg-tME04h7_ZhIXeYYRmHFCYA401OrogX2vuemY13aJm0eqRxjFlaVWxr-wHBlQVUmMtj7P24atRSdIbS2jEAINguvf7hWl3O0M_L_6gbCfPcvouMU Jun 22 08:51:33.847160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Domain-Id: None Jun 22 08:51:33.847160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Domain-Name: None Jun 22 08:51:33.847160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Identity-Status: Confirmed Jun 22 08:51:33.847160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Is-Admin-Project: True Jun 22 08:51:33.847160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 08:51:33.847160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Project-Domain-Id: default Jun 22 08:51:33.847160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Project-Domain-Name: Default Jun 22 08:51:33.847160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Project-Id: f402cbaaeeca4e1986ebe320dcfedbb1 Jun 22 08:51:33.847160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Project-Name: admin Jun 22 08:51:33.847160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Role: member,reader,admin Jun 22 08:51:33.847160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Roles: member,reader,admin Jun 22 08:51:33.854876 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f402cbaaeeca4e1986ebe320dcfedbb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f402cbaaeeca4e1986ebe320dcfedbb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f402cbaaeeca4e1986ebe320dcfedbb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f402cbaaeeca4e1986ebe320dcfedbb1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 08:51:33.854876 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Tenant: admin Jun 22 08:51:33.854876 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Tenant-Id: f402cbaaeeca4e1986ebe320dcfedbb1 Jun 22 08:51:33.854876 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Tenant-Name: admin Jun 22 08:51:33.854876 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-User: admin Jun 22 08:51:33.854876 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-User-Domain-Id: default Jun 22 08:51:33.854876 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-User-Domain-Name: Default Jun 22 08:51:33.854876 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-User-Id: f02f025a6a5540ff82662f286ae57c54 Jun 22 08:51:33.854876 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-User-Name: admin Jun 22 08:51:33.854876 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: method: > Jun 22 08:51:33.854876 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: exception: Flavor 42 could not be found. Jun 22 08:51:33.854876 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: action_args: {'id': '42'} Jun 22 08:51:33.854876 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 08:51:33.854876 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:51:33.855865 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 08:51:33.855865 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 08:51:33.855865 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 08:51:33.855865 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 08:51:33.855865 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 08:51:33.855865 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 08:51:33.855865 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 08:51:33.855865 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 08:51:33.855865 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 08:51:33.855865 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 08:51:33.855865 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 08:51:33.855865 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 08:51:33.855865 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 22 08:51:33.855865 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi Jun 22 08:51:33.855865 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 08:51:33.855865 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi Jun 22 08:51:33.855865 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:51:33.855865 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 08:51:33.855865 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 08:51:33.857160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 08:51:33.857160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 08:51:33.857160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 08:51:33.857160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 08:51:33.857160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 08:51:33.857160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 08:51:33.857160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 22 08:51:33.857160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi Jun 22 08:51:33.857160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 08:51:33.857160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi Jun 22 08:51:33.857160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:51:33.857160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 08:51:33.857160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 08:51:33.857160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 08:51:33.857160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 08:51:33.857160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 22 08:51:33.857160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi Jun 22 08:51:33.857160 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-79d02ad8-38df-4c5e-9b6a-eb9e3d027502 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 08:51:33.858424 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-79d02ad8-38df-4c5e-9b6a-eb9e3d027502 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015135 Jun 22 08:51:33.858424 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1190 bytes} [Wed Jun 22 08:51:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 08:51:34.663217 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-cbc47685-7862-4f08-bc07-4a4c47fbcbdd admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:51:34.664213 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-cbc47685-7862-4f08-bc07-4a4c47fbcbdd admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 Jun 22 08:51:34.664597 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 21/43] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Jun 22 08:51:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:51:34.855175 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-080769ec-5f12-4163-b777-6f9fbee8b12a admin admin] Calling method '>' {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:51:34.862710 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.wsgi [None req-080769ec-5f12-4163-b777-6f9fbee8b12a admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 22 08:51:34.864185 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-080769ec-5f12-4163-b777-6f9fbee8b12a admin admin] Request method failure captured: Jun 22 08:51:34.864185 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 22 08:51:34.864185 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: Accept: application/json Jun 22 08:51:34.864185 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: Accept-Encoding: gzip, deflate Jun 22 08:51:34.864185 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: Connection: keep-alive Jun 22 08:51:34.864185 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: Content-Length: 0 Jun 22 08:51:34.864185 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: Host: 10.222.0.16 Jun 22 08:51:34.864185 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: Openstack-Api-Version: compute 2.90 Jun 22 08:51:34.864185 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: Openstack-System-Scope: None Jun 22 08:51:34.864185 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: User-Agent: python-novaclient Jun 22 08:51:34.864185 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Auth-Token: gAAAAABistgW_yDivettgXvucZNrz64rxVnuMpWl11w_OqCJPmSkdyBryMW9OH0jdluSS3UlQHNiCrnZAD0XQpFgZE2Ih9jQRTt55hxp2X0p6Hu1cNESAE0O-Oy6EKK6RGsJcQdAyf2aRredMRqYwwgJ99EbSC2jP_6DYaDagKDgLFzCGC0W_s4 Jun 22 08:51:34.864185 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Domain-Id: None Jun 22 08:51:34.864185 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Domain-Name: None Jun 22 08:51:34.864185 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Identity-Status: Confirmed Jun 22 08:51:34.864185 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Is-Admin-Project: True Jun 22 08:51:34.864185 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 08:51:34.864185 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Project-Domain-Id: default Jun 22 08:51:34.864185 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Project-Domain-Name: Default Jun 22 08:51:34.864185 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Project-Id: f402cbaaeeca4e1986ebe320dcfedbb1 Jun 22 08:51:34.864185 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Project-Name: admin Jun 22 08:51:34.864185 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Role: member,reader,admin Jun 22 08:51:34.864185 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Roles: member,reader,admin Jun 22 08:51:34.865978 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f402cbaaeeca4e1986ebe320dcfedbb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f402cbaaeeca4e1986ebe320dcfedbb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f402cbaaeeca4e1986ebe320dcfedbb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f402cbaaeeca4e1986ebe320dcfedbb1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 08:51:34.865978 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Tenant: admin Jun 22 08:51:34.865978 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Tenant-Id: f402cbaaeeca4e1986ebe320dcfedbb1 Jun 22 08:51:34.865978 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Tenant-Name: admin Jun 22 08:51:34.865978 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-User: admin Jun 22 08:51:34.865978 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-User-Domain-Id: default Jun 22 08:51:34.865978 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-User-Domain-Name: Default Jun 22 08:51:34.865978 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-User-Id: f02f025a6a5540ff82662f286ae57c54 Jun 22 08:51:34.865978 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-User-Name: admin Jun 22 08:51:34.865978 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: method: > Jun 22 08:51:34.865978 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: exception: Flavor 84 could not be found. Jun 22 08:51:34.865978 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: action_args: {'id': '84'} Jun 22 08:51:34.865978 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 08:51:34.865978 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:51:34.866980 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 08:51:34.866980 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 08:51:34.866980 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 08:51:34.866980 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 08:51:34.866980 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 08:51:34.866980 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 08:51:34.866980 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 08:51:34.866980 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 08:51:34.866980 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 08:51:34.866980 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 08:51:34.866980 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 08:51:34.866980 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 08:51:34.866980 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 22 08:51:34.866980 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi Jun 22 08:51:34.866980 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 08:51:34.866980 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi Jun 22 08:51:34.866980 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:51:34.866980 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 08:51:34.866980 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 08:51:34.868327 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 08:51:34.868327 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 08:51:34.868327 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 08:51:34.868327 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 08:51:34.868327 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 08:51:34.868327 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 08:51:34.868327 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 22 08:51:34.868327 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi Jun 22 08:51:34.868327 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 08:51:34.868327 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi Jun 22 08:51:34.868327 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:51:34.868327 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 08:51:34.868327 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 08:51:34.868327 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 08:51:34.868327 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 08:51:34.868327 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 22 08:51:34.868327 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi Jun 22 08:51:34.868327 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-080769ec-5f12-4163-b777-6f9fbee8b12a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 08:51:34.869656 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-080769ec-5f12-4163-b777-6f9fbee8b12a admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.063143 Jun 22 08:51:34.869656 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1190 bytes} [Wed Jun 22 08:51:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 08:51:34.875808 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-3ac2ad99-89d1-497a-ae37-4aa05f8d6578 admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:51:34.889803 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-3ac2ad99-89d1-497a-ae37-4aa05f8d6578 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018187 Jun 22 08:51:34.890329 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Jun 22 08:51:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:51:34.899748 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-6dde2290-510a-4e9d-9cd1-b4d9b515fa5b admin admin] Calling method '>' {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:51:34.913191 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-6dde2290-510a-4e9d-9cd1-b4d9b515fa5b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017197 Jun 22 08:51:34.913714 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Jun 22 08:51:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:51:34.922431 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-6edcf84c-b948-4bae-b89f-bc174d6751a5 admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:51:34.927800 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.wsgi [None req-6edcf84c-b948-4bae-b89f-bc174d6751a5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 22 08:51:34.929334 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-6edcf84c-b948-4bae-b89f-bc174d6751a5 admin admin] Request method failure captured: Jun 22 08:51:34.929334 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 22 08:51:34.929334 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: Accept: application/json Jun 22 08:51:34.929334 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: Accept-Encoding: gzip, deflate Jun 22 08:51:34.929334 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: Connection: keep-alive Jun 22 08:51:34.929334 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: Content-Length: 0 Jun 22 08:51:34.929334 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: Host: 10.222.0.16 Jun 22 08:51:34.929334 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: Openstack-Api-Version: compute 2.90 Jun 22 08:51:34.929334 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: Openstack-System-Scope: None Jun 22 08:51:34.929334 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: User-Agent: python-novaclient Jun 22 08:51:34.929334 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Auth-Token: gAAAAABistgW_yDivettgXvucZNrz64rxVnuMpWl11w_OqCJPmSkdyBryMW9OH0jdluSS3UlQHNiCrnZAD0XQpFgZE2Ih9jQRTt55hxp2X0p6Hu1cNESAE0O-Oy6EKK6RGsJcQdAyf2aRredMRqYwwgJ99EbSC2jP_6DYaDagKDgLFzCGC0W_s4 Jun 22 08:51:34.929334 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Domain-Id: None Jun 22 08:51:34.929334 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Domain-Name: None Jun 22 08:51:34.929334 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Identity-Status: Confirmed Jun 22 08:51:34.929334 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Is-Admin-Project: True Jun 22 08:51:34.929334 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 08:51:34.929334 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Project-Domain-Id: default Jun 22 08:51:34.929334 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Project-Domain-Name: Default Jun 22 08:51:34.929334 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Project-Id: f402cbaaeeca4e1986ebe320dcfedbb1 Jun 22 08:51:34.929334 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Project-Name: admin Jun 22 08:51:34.929334 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Role: member,reader,admin Jun 22 08:51:34.929334 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Roles: member,reader,admin Jun 22 08:51:34.930864 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f402cbaaeeca4e1986ebe320dcfedbb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f402cbaaeeca4e1986ebe320dcfedbb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f402cbaaeeca4e1986ebe320dcfedbb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f402cbaaeeca4e1986ebe320dcfedbb1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 08:51:34.930864 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Tenant: admin Jun 22 08:51:34.930864 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Tenant-Id: f402cbaaeeca4e1986ebe320dcfedbb1 Jun 22 08:51:34.930864 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Tenant-Name: admin Jun 22 08:51:34.930864 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-User: admin Jun 22 08:51:34.930864 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-User-Domain-Id: default Jun 22 08:51:34.930864 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-User-Domain-Name: Default Jun 22 08:51:34.930864 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-User-Id: f02f025a6a5540ff82662f286ae57c54 Jun 22 08:51:34.930864 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-User-Name: admin Jun 22 08:51:34.930864 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: method: > Jun 22 08:51:34.930864 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: exception: Flavor 84 could not be found. Jun 22 08:51:34.930864 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: action_args: {'id': '84'} Jun 22 08:51:34.930864 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 08:51:34.930864 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:51:34.931723 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 08:51:34.931723 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 08:51:34.931723 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 08:51:34.931723 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 08:51:34.931723 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 08:51:34.931723 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 08:51:34.931723 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 08:51:34.931723 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 08:51:34.931723 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 08:51:34.931723 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 08:51:34.931723 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 08:51:34.931723 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 08:51:34.931723 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 22 08:51:34.931723 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Jun 22 08:51:34.931723 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 08:51:34.931723 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Jun 22 08:51:34.931723 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:51:34.931723 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 08:51:34.931723 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 08:51:34.933067 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 08:51:34.933067 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 08:51:34.933067 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 08:51:34.933067 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 08:51:34.933067 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 08:51:34.933067 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 08:51:34.933067 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 22 08:51:34.933067 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Jun 22 08:51:34.933067 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 08:51:34.933067 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Jun 22 08:51:34.933067 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:51:34.933067 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 08:51:34.933067 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 08:51:34.933067 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 08:51:34.933067 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 08:51:34.933067 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 22 08:51:34.933067 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Jun 22 08:51:34.933067 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-6edcf84c-b948-4bae-b89f-bc174d6751a5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 08:51:34.934278 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-6edcf84c-b948-4bae-b89f-bc174d6751a5 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011724 Jun 22 08:51:34.934278 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 23/47] 10.222.0.16 () {60 vars in 1190 bytes} [Wed Jun 22 08:51:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 22 08:51:35.745994 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-6dde2290-510a-4e9d-9cd1-b4d9b515fa5b admin admin] Calling method '>' {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:51:35.746974 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-6dde2290-510a-4e9d-9cd1-b4d9b515fa5b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001385 Jun 22 08:51:35.747393 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 25/48] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Jun 22 08:51:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:51:35.941818 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-224a7dc3-6267-4d0a-b6fa-6289db334190 admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:51:35.947457 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.wsgi [None req-224a7dc3-6267-4d0a-b6fa-6289db334190 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 22 08:51:35.948975 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-224a7dc3-6267-4d0a-b6fa-6289db334190 admin admin] Request method failure captured: Jun 22 08:51:35.948975 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 22 08:51:35.948975 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: Accept: application/json Jun 22 08:51:35.948975 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: Accept-Encoding: gzip, deflate Jun 22 08:51:35.948975 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: Connection: keep-alive Jun 22 08:51:35.948975 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: Content-Length: 0 Jun 22 08:51:35.948975 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: Host: 10.222.0.16 Jun 22 08:51:35.948975 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: Openstack-Api-Version: compute 2.90 Jun 22 08:51:35.948975 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: Openstack-System-Scope: None Jun 22 08:51:35.948975 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: User-Agent: python-novaclient Jun 22 08:51:35.948975 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Auth-Token: gAAAAABistgXIZuTENc211CSgC8GBXDOF3TliBK-9zTCXrZJ27c62RctzxaBC1go3nd1XeP5x6-qytA2_bYp_78nBlsF3MLNHKTPn7uh5GLdbbXj5baD7jIsjV2u_bDLSLKdzn1IFDjyuIO2cG6yAx1_aL-YEwrRciySh8_K7pcAhMTZ6pqAU5Q Jun 22 08:51:35.948975 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Domain-Id: None Jun 22 08:51:35.948975 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Domain-Name: None Jun 22 08:51:35.948975 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Identity-Status: Confirmed Jun 22 08:51:35.948975 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Is-Admin-Project: True Jun 22 08:51:35.948975 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 08:51:35.948975 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Project-Domain-Id: default Jun 22 08:51:35.948975 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Project-Domain-Name: Default Jun 22 08:51:35.948975 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Project-Id: f402cbaaeeca4e1986ebe320dcfedbb1 Jun 22 08:51:35.948975 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Project-Name: admin Jun 22 08:51:35.948975 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Role: member,reader,admin Jun 22 08:51:35.948975 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Roles: member,reader,admin Jun 22 08:51:35.950549 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f402cbaaeeca4e1986ebe320dcfedbb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f402cbaaeeca4e1986ebe320dcfedbb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f402cbaaeeca4e1986ebe320dcfedbb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f402cbaaeeca4e1986ebe320dcfedbb1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 08:51:35.950549 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Tenant: admin Jun 22 08:51:35.950549 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Tenant-Id: f402cbaaeeca4e1986ebe320dcfedbb1 Jun 22 08:51:35.950549 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-Tenant-Name: admin Jun 22 08:51:35.950549 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-User: admin Jun 22 08:51:35.950549 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-User-Domain-Id: default Jun 22 08:51:35.950549 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-User-Domain-Name: Default Jun 22 08:51:35.950549 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-User-Id: f02f025a6a5540ff82662f286ae57c54 Jun 22 08:51:35.950549 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: X-User-Name: admin Jun 22 08:51:35.950549 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: method: > Jun 22 08:51:35.950549 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: exception: Flavor 451 could not be found. Jun 22 08:51:35.950549 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: action_args: {'id': '451'} Jun 22 08:51:35.950549 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 08:51:35.950549 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:51:35.952093 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 08:51:35.952093 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 08:51:35.952093 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 08:51:35.952093 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 08:51:35.952093 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 08:51:35.952093 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 08:51:35.952093 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 08:51:35.952093 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 08:51:35.952093 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 08:51:35.952093 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 08:51:35.952093 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 08:51:35.952093 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 08:51:35.952093 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 22 08:51:35.952093 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Jun 22 08:51:35.952093 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 08:51:35.952093 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Jun 22 08:51:35.952093 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:51:35.952093 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 08:51:35.952093 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 08:51:35.953479 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 08:51:35.953479 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 08:51:35.953479 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 08:51:35.953479 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 08:51:35.953479 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 08:51:35.953479 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 08:51:35.953479 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 22 08:51:35.953479 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Jun 22 08:51:35.953479 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 08:51:35.953479 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Jun 22 08:51:35.953479 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:51:35.953479 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 08:51:35.953479 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 08:51:35.953479 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 08:51:35.953479 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 08:51:35.953479 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 22 08:51:35.953479 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Jun 22 08:51:35.953479 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-224a7dc3-6267-4d0a-b6fa-6289db334190 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 08:51:35.954706 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-224a7dc3-6267-4d0a-b6fa-6289db334190 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060001 Jun 22 08:51:35.954706 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 24/49] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Jun 22 08:51:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 08:51:35.960832 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-1cd6198c-1de5-4c58-a477-1ff23d71cf9c admin admin] Calling method '>' {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:51:35.974834 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-1cd6198c-1de5-4c58-a477-1ff23d71cf9c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017830 Jun 22 08:51:35.975340 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Jun 22 08:51:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:51:35.984474 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-65c0f52d-fce9-4885-a4f3-add3187cab93 admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:51:35.997627 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-65c0f52d-fce9-4885-a4f3-add3187cab93 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016706 Jun 22 08:51:35.998192 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 25/51] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Jun 22 08:51:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:51:36.007029 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-bfc901e9-15a3-4fe8-8d72-537e88aabd00 admin admin] Calling method '>' {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:51:36.012176 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.wsgi [None req-bfc901e9-15a3-4fe8-8d72-537e88aabd00 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 22 08:51:36.014325 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-bfc901e9-15a3-4fe8-8d72-537e88aabd00 admin admin] Request method failure captured: Jun 22 08:51:36.014325 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 22 08:51:36.014325 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: Accept: application/json Jun 22 08:51:36.014325 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: Accept-Encoding: gzip, deflate Jun 22 08:51:36.014325 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: Connection: keep-alive Jun 22 08:51:36.014325 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: Content-Length: 0 Jun 22 08:51:36.014325 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: Host: 10.222.0.16 Jun 22 08:51:36.014325 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: Openstack-Api-Version: compute 2.90 Jun 22 08:51:36.014325 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: Openstack-System-Scope: None Jun 22 08:51:36.014325 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: User-Agent: python-novaclient Jun 22 08:51:36.014325 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Auth-Token: gAAAAABistgXIZuTENc211CSgC8GBXDOF3TliBK-9zTCXrZJ27c62RctzxaBC1go3nd1XeP5x6-qytA2_bYp_78nBlsF3MLNHKTPn7uh5GLdbbXj5baD7jIsjV2u_bDLSLKdzn1IFDjyuIO2cG6yAx1_aL-YEwrRciySh8_K7pcAhMTZ6pqAU5Q Jun 22 08:51:36.014325 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Domain-Id: None Jun 22 08:51:36.014325 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Domain-Name: None Jun 22 08:51:36.014325 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Identity-Status: Confirmed Jun 22 08:51:36.014325 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Is-Admin-Project: True Jun 22 08:51:36.014325 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 08:51:36.014325 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Project-Domain-Id: default Jun 22 08:51:36.014325 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Project-Domain-Name: Default Jun 22 08:51:36.014325 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Project-Id: f402cbaaeeca4e1986ebe320dcfedbb1 Jun 22 08:51:36.014325 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Project-Name: admin Jun 22 08:51:36.014325 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Role: member,reader,admin Jun 22 08:51:36.014325 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Roles: member,reader,admin Jun 22 08:51:36.016138 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f402cbaaeeca4e1986ebe320dcfedbb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f402cbaaeeca4e1986ebe320dcfedbb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f402cbaaeeca4e1986ebe320dcfedbb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f402cbaaeeca4e1986ebe320dcfedbb1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 08:51:36.016138 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Tenant: admin Jun 22 08:51:36.016138 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Tenant-Id: f402cbaaeeca4e1986ebe320dcfedbb1 Jun 22 08:51:36.016138 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-Tenant-Name: admin Jun 22 08:51:36.016138 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-User: admin Jun 22 08:51:36.016138 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-User-Domain-Id: default Jun 22 08:51:36.016138 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-User-Domain-Name: Default Jun 22 08:51:36.016138 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-User-Id: f02f025a6a5540ff82662f286ae57c54 Jun 22 08:51:36.016138 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: X-User-Name: admin Jun 22 08:51:36.016138 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: method: > Jun 22 08:51:36.016138 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: exception: Flavor 451 could not be found. Jun 22 08:51:36.016138 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: action_args: {'id': '451'} Jun 22 08:51:36.016138 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 08:51:36.016138 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:51:36.017363 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 08:51:36.017363 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 08:51:36.017363 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 08:51:36.017363 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 08:51:36.017363 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 08:51:36.017363 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 08:51:36.017363 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 08:51:36.017363 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 08:51:36.017363 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 08:51:36.017363 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 08:51:36.017363 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 08:51:36.017363 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 08:51:36.017363 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 22 08:51:36.017363 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi Jun 22 08:51:36.017363 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 08:51:36.017363 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi Jun 22 08:51:36.017363 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:51:36.017363 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 08:51:36.017363 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 08:51:36.018652 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 08:51:36.018652 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 08:51:36.018652 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 08:51:36.018652 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 08:51:36.018652 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 08:51:36.018652 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 08:51:36.018652 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 22 08:51:36.018652 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi Jun 22 08:51:36.018652 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 08:51:36.018652 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi Jun 22 08:51:36.018652 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:51:36.018652 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 08:51:36.018652 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 08:51:36.018652 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 08:51:36.018652 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 08:51:36.018652 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 22 08:51:36.018652 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: ERROR nova.api.openstack.wsgi Jun 22 08:51:36.018652 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-bfc901e9-15a3-4fe8-8d72-537e88aabd00 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 08:51:36.019897 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-bfc901e9-15a3-4fe8-8d72-537e88aabd00 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012208 Jun 22 08:51:36.019897 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 27/52] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Jun 22 08:51:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 08:51:36.832074 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-65c0f52d-fce9-4885-a4f3-add3187cab93 admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:51:36.833150 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-65c0f52d-fce9-4885-a4f3-add3187cab93 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jun 22 08:51:36.833794 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Jun 22 08:51:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:51:37.023703 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-963cd02c-9672-4073-90cb-350129272c3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:51:37.109102 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-963cd02c-9672-4073-90cb-350129272c3f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.136992 Jun 22 08:51:37.109666 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 28/54] 10.222.0.16 () {64 vars in 1235 bytes} [Wed Jun 22 08:51:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 08:51:37.931429 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-65c0f52d-fce9-4885-a4f3-add3187cab93 admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:51:37.932420 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-65c0f52d-fce9-4885-a4f3-add3187cab93 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 Jun 22 08:51:37.932992 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Jun 22 08:51:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:51:38.122144 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-e911e148-6f47-41cb-b31d-5bd1326ad902 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:51:38.202329 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-e911e148-6f47-41cb-b31d-5bd1326ad902 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.131394 Jun 22 08:51:38.202821 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1235 bytes} [Wed Jun 22 08:51:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 08:51:39.029831 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-65c0f52d-fce9-4885-a4f3-add3187cab93 admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:51:39.030917 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-65c0f52d-fce9-4885-a4f3-add3187cab93 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002193 Jun 22 08:51:39.031318 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Jun 22 08:51:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 08:51:39.222369 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-c1d080f9-b13d-4a37-944f-22ade8dafa4f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:51:39.302842 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-c1d080f9-b13d-4a37-944f-22ade8dafa4f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.132545 Jun 22 08:51:39.303354 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 30/58] 10.222.0.16 () {64 vars in 1235 bytes} [Wed Jun 22 08:51:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 08:51:40.143626 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-65c0f52d-fce9-4885-a4f3-add3187cab93 admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:51:40.144632 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-65c0f52d-fce9-4885-a4f3-add3187cab93 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Jun 22 08:51:40.145060 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 29/59] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Jun 22 08:51:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:51:40.336687 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-b524517b-72c0-46bd-a2f3-2a3479142208 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:51:40.419298 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-b524517b-72c0-46bd-a2f3-2a3479142208 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.135356 Jun 22 08:51:40.420537 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 31/60] 10.222.0.16 () {64 vars in 1235 bytes} [Wed Jun 22 08:51:40 2022] POST /compute/v2.1/flavors => generated 409 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 08:51:41.246722 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-65c0f52d-fce9-4885-a4f3-add3187cab93 admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:51:41.248445 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-65c0f52d-fce9-4885-a4f3-add3187cab93 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001397 Jun 22 08:51:41.248893 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 30/61] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Jun 22 08:51:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:51:41.445100 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-7f56d12a-a7ad-4557-9ce6-6c703d669531 admin admin] Calling method '>' {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:51:41.464856 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-7f56d12a-a7ad-4557-9ce6-6c703d669531 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071713 Jun 22 08:51:41.465383 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1202 bytes} [Wed Jun 22 08:51:41 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 08:52:28.095597 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-65c0f52d-fce9-4885-a4f3-add3187cab93 admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:52:28.096583 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-65c0f52d-fce9-4885-a4f3-add3187cab93 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jun 22 08:52:28.097030 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 31/63] 10.222.0.16 () {54 vars in 930 bytes} [Wed Jun 22 08:52:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:52:28.107026 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG dbcounter [-] [103448] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:28.155090 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-799ba092-e06f-4ef2-9db3-529bad446a15 admin admin] Calling method '>' {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:52:28.173486 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-799ba092-e06f-4ef2-9db3-529bad446a15 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070881 Jun 22 08:52:28.174011 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 33/64] 10.222.0.16 () {60 vars in 1291 bytes} [Wed Jun 22 08:52:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:52:28.196973 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-60ab0bbe-e4a2-494e-a85c-f43f9ff0a85d admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:52:28.200985 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG dbcounter [-] [103449] Writing DB stats nova_api:SELECT=14 {{(pid=103449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:28.205883 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-60ab0bbe-e4a2-494e-a85c-f43f9ff0a85d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012467 Jun 22 08:52:28.211707 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 32/65] 10.222.0.16 () {60 vars in 1282 bytes} [Wed Jun 22 08:52:28 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:52:28.218065 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-e8339d5a-e5cc-4905-87f8-4f11fde48f5e admin admin] Calling method '>' {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:52:28.225766 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-e8339d5a-e5cc-4905-87f8-4f11fde48f5e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011367 Jun 22 08:52:28.226266 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 34/66] 10.222.0.16 () {60 vars in 1285 bytes} [Wed Jun 22 08:52:28 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:52:28.238424 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-7b8054d7-5785-4bdb-99a5-34ea4839084c admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:52:28.246317 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-7b8054d7-5785-4bdb-99a5-34ea4839084c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011426 Jun 22 08:52:28.247488 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 33/67] 10.222.0.16 () {60 vars in 1285 bytes} [Wed Jun 22 08:52:28 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:52:28.258249 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-9258b61e-540f-46b1-a612-80912757595a admin admin] Calling method '>' {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:52:28.265954 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-9258b61e-540f-46b1-a612-80912757595a admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011148 Jun 22 08:52:28.266476 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 35/68] 10.222.0.16 () {60 vars in 1282 bytes} [Wed Jun 22 08:52:28 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:55:58.476442 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-7b8054d7-5785-4bdb-99a5-34ea4839084c admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:55:58.477476 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-7b8054d7-5785-4bdb-99a5-34ea4839084c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jun 22 08:55:58.477875 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 34/69] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Jun 22 08:55:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:55:58.623537 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG dbcounter [-] [103448] Writing DB stats nova_api:SELECT=6 {{(pid=103448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:55:58.736997 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-1fa15eee-f8de-4dc4-a300-f506b40e6bc3 admin admin] Calling method '>' {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:55:58.738189 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:55:58.738189 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: warnings.warn(msg) Jun 22 08:55:58.739384 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG oslo_concurrency.lockutils [None req-1fa15eee-f8de-4dc4-a300-f506b40e6bc3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:55:58.739826 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG oslo_concurrency.lockutils [None req-1fa15eee-f8de-4dc4-a300-f506b40e6bc3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:55:58.740604 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG oslo_concurrency.lockutils [None req-1fa15eee-f8de-4dc4-a300-f506b40e6bc3 admin admin] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:55:58.741064 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG oslo_concurrency.lockutils [None req-1fa15eee-f8de-4dc4-a300-f506b40e6bc3 admin admin] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:55:58.774458 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-1fa15eee-f8de-4dc4-a300-f506b40e6bc3 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.152287 Jun 22 08:55:58.775006 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 36/70] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Jun 22 08:55:58 2022] GET /compute/v2.1/os-services => generated 791 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 08:55:59.649272 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-7b8054d7-5785-4bdb-99a5-34ea4839084c admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:55:59.650278 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-7b8054d7-5785-4bdb-99a5-34ea4839084c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Jun 22 08:55:59.650670 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 35/71] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Jun 22 08:55:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:55:59.842667 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-ae09c0f4-a6b6-4a6a-8b4b-bf421d2b2f1c admin admin] Calling method '>' {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:55:59.843887 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:55:59.843887 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: warnings.warn(msg) Jun 22 08:55:59.845076 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG oslo_concurrency.lockutils [None req-ae09c0f4-a6b6-4a6a-8b4b-bf421d2b2f1c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:55:59.845509 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG oslo_concurrency.lockutils [None req-ae09c0f4-a6b6-4a6a-8b4b-bf421d2b2f1c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:55:59.846278 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG oslo_concurrency.lockutils [None req-ae09c0f4-a6b6-4a6a-8b4b-bf421d2b2f1c admin admin] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:55:59.846719 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG oslo_concurrency.lockutils [None req-ae09c0f4-a6b6-4a6a-8b4b-bf421d2b2f1c admin admin] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:55:59.865593 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-ae09c0f4-a6b6-4a6a-8b4b-bf421d2b2f1c admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075423 Jun 22 08:55:59.866067 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 37/72] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Jun 22 08:55:59 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 08:56:11.167490 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-7b8054d7-5785-4bdb-99a5-34ea4839084c admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:56:11.168552 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-7b8054d7-5785-4bdb-99a5-34ea4839084c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jun 22 08:56:11.169048 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 36/73] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Jun 22 08:56:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:56:11.313658 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG dbcounter [-] [103448] Writing DB stats nova_cell0:SELECT=4 {{(pid=103448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:56:11.314822 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG dbcounter [-] [103448] Writing DB stats nova_cell1:SELECT=4 {{(pid=103448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:56:11.315442 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG dbcounter [-] [103448] Writing DB stats nova_api:SELECT=8 {{(pid=103448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:56:11.364680 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-c7655f68-8fbc-42ad-b596-47fc75c4e705 admin admin] Calling method '>' {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:56:11.365541 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:56:11.365541 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: warnings.warn(msg) Jun 22 08:56:11.366760 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG oslo_concurrency.lockutils [None req-c7655f68-8fbc-42ad-b596-47fc75c4e705 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:56:11.367191 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG oslo_concurrency.lockutils [None req-c7655f68-8fbc-42ad-b596-47fc75c4e705 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:56:11.367974 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG oslo_concurrency.lockutils [None req-c7655f68-8fbc-42ad-b596-47fc75c4e705 admin admin] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:56:11.368393 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG oslo_concurrency.lockutils [None req-c7655f68-8fbc-42ad-b596-47fc75c4e705 admin admin] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:56:11.393782 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-c7655f68-8fbc-42ad-b596-47fc75c4e705 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085117 Jun 22 08:56:11.395844 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 38/74] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Jun 22 08:56:11 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:56:12.229633 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-7b8054d7-5785-4bdb-99a5-34ea4839084c admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:56:12.230620 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-7b8054d7-5785-4bdb-99a5-34ea4839084c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 Jun 22 08:56:12.231014 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 37/75] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Jun 22 08:56:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:56:12.421252 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG nova.api.openstack.wsgi [None req-3e116fa2-4918-4a3c-9afe-aab37b406762 admin admin] Calling method '>' {{(pid=103448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:56:12.422606 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:56:12.422606 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: warnings.warn(msg) Jun 22 08:56:12.423871 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG oslo_concurrency.lockutils [None req-3e116fa2-4918-4a3c-9afe-aab37b406762 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:56:12.424328 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG oslo_concurrency.lockutils [None req-3e116fa2-4918-4a3c-9afe-aab37b406762 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:56:12.425148 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG oslo_concurrency.lockutils [None req-3e116fa2-4918-4a3c-9afe-aab37b406762 admin admin] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:56:12.425577 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: DEBUG oslo_concurrency.lockutils [None req-3e116fa2-4918-4a3c-9afe-aab37b406762 admin admin] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:56:12.447663 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: INFO nova.api.openstack.requestlog [None req-3e116fa2-4918-4a3c-9afe-aab37b406762 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.077842 Jun 22 08:56:12.448221 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: [pid: 103448|app: 0|req: 39/76] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Jun 22 08:56:12 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:57:10.280607 dv-cinder-845990-3-iscsi devstack@n-api.service[103447]: Wed Jun 22 08:57:10 2022 - graceful shutdown triggered... Jun 22 08:57:10.281399 dv-cinder-845990-3-iscsi devstack@n-api.service[103449]: Gracefully killing worker 2 (pid: 103449)... Jun 22 08:57:10.280728 dv-cinder-845990-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 22 08:57:10.282639 dv-cinder-845990-3-iscsi devstack@n-api.service[103448]: Gracefully killing worker 1 (pid: 103448)... Jun 22 08:57:11.281192 dv-cinder-845990-3-iscsi devstack@n-api.service[103447]: worker 1 buried after 1 seconds Jun 22 08:57:11.281594 dv-cinder-845990-3-iscsi devstack@n-api.service[103447]: worker 2 buried after 1 seconds Jun 22 08:57:11.281594 dv-cinder-845990-3-iscsi devstack@n-api.service[103447]: goodbye to uWSGI. Jun 22 08:57:11.282754 dv-cinder-845990-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 22 08:57:11.283292 dv-cinder-845990-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 22 08:57:11.286062 dv-cinder-845990-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 22 08:57:11.297335 dv-cinder-845990-3-iscsi devstack@n-api.service[118004]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 22 08:57:11.300424 dv-cinder-845990-3-iscsi devstack@n-api.service[118004]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 22 08:57:11 2022] *** Jun 22 08:57:11.300575 dv-cinder-845990-3-iscsi devstack@n-api.service[118004]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 22 08:57:11.300705 dv-cinder-845990-3-iscsi devstack@n-api.service[118004]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 22 08:57:11.300849 dv-cinder-845990-3-iscsi devstack@n-api.service[118004]: nodename: dv-cinder-845990-3-iscsi Jun 22 08:57:11.300947 dv-cinder-845990-3-iscsi devstack@n-api.service[118004]: machine: x86_64 Jun 22 08:57:11.301053 dv-cinder-845990-3-iscsi devstack@n-api.service[118004]: clock source: unix Jun 22 08:57:11.301053 dv-cinder-845990-3-iscsi devstack@n-api.service[118004]: pcre jit disabled Jun 22 08:57:11.301053 dv-cinder-845990-3-iscsi devstack@n-api.service[118004]: detected number of CPU cores: 4 Jun 22 08:57:11.301053 dv-cinder-845990-3-iscsi devstack@n-api.service[118004]: current working directory: / Jun 22 08:57:11.301053 dv-cinder-845990-3-iscsi devstack@n-api.service[118004]: detected binary path: /usr/bin/uwsgi-core Jun 22 08:57:11.301053 dv-cinder-845990-3-iscsi devstack@n-api.service[118004]: your processes number limit is 47680 Jun 22 08:57:11.301053 dv-cinder-845990-3-iscsi devstack@n-api.service[118004]: your memory page size is 4096 bytes Jun 22 08:57:11.301053 dv-cinder-845990-3-iscsi devstack@n-api.service[118004]: detected max file descriptor number: 2048 Jun 22 08:57:11.301053 dv-cinder-845990-3-iscsi devstack@n-api.service[118004]: lock engine: pthread robust mutexes Jun 22 08:57:11.301679 dv-cinder-845990-3-iscsi devstack@n-api.service[118004]: thunder lock: enabled Jun 22 08:57:11.301679 dv-cinder-845990-3-iscsi devstack@n-api.service[118004]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 22 08:57:11.301679 dv-cinder-845990-3-iscsi devstack@n-api.service[118004]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 22 08:57:11.346278 dv-cinder-845990-3-iscsi devstack@n-api.service[118004]: Python main interpreter initialized at 0x564d611cb9c0 Jun 22 08:57:11.346278 dv-cinder-845990-3-iscsi devstack@n-api.service[118004]: python threads support enabled Jun 22 08:57:11.346278 dv-cinder-845990-3-iscsi devstack@n-api.service[118004]: your server socket listen backlog is limited to 100 connections Jun 22 08:57:11.346278 dv-cinder-845990-3-iscsi devstack@n-api.service[118004]: your mercy for graceful operations on workers is 90 seconds Jun 22 08:57:11.346663 dv-cinder-845990-3-iscsi devstack@n-api.service[118004]: mapped 403077 bytes (393 KB) for 2 cores Jun 22 08:57:11.346663 dv-cinder-845990-3-iscsi devstack@n-api.service[118004]: *** Operational MODE: preforking *** Jun 22 08:57:11.346952 dv-cinder-845990-3-iscsi devstack@n-api.service[118004]: *** uWSGI is running in multiple interpreter mode *** Jun 22 08:57:11.346952 dv-cinder-845990-3-iscsi devstack@n-api.service[118004]: spawned uWSGI master process (pid: 118004) Jun 22 08:57:11.347161 dv-cinder-845990-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 22 08:57:11.352804 dv-cinder-845990-3-iscsi devstack@n-api.service[118004]: spawned uWSGI worker 1 (pid: 118024, cores: 1) Jun 22 08:57:11.352804 dv-cinder-845990-3-iscsi devstack@n-api.service[118004]: spawned uWSGI worker 2 (pid: 118025, cores: 1) Jun 22 08:57:11.352804 dv-cinder-845990-3-iscsi devstack@n-api.service[118004]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 22 08:57:12.016406 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 08:57:12.017487 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 08:57:13.228712 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 08:57:13.228712 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: from cryptography.utils import int_from_bytes Jun 22 08:57:13.229454 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 08:57:13.229454 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: from cryptography.utils import int_from_bytes Jun 22 08:57:13.231926 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 08:57:13.231926 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: from cryptography.utils import int_from_bytes Jun 22 08:57:13.232349 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 08:57:13.232349 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: from cryptography.utils import int_from_bytes Jun 22 08:57:15.623859 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 08:57:15.624414 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 08:57:15.624682 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 08:57:15.625058 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 08:57:15.625321 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 08:57:15.625712 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.626038 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.626361 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.626679 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.627007 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.627451 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.627985 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.628320 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.628652 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.628962 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.629269 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.629595 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845990-3-iscsi {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.629922 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.630234 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.630545 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.630866 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.631189 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.631494 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.631808 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.633539 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.633539 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.633539 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.633539 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.633886 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.634024 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.634322 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.634652 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.634962 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.635279 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.635381 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 08:57:15.635798 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.635888 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 08:57:15.635971 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845990-3-iscsi {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.636144 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 08:57:15.636283 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.636494 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 08:57:15.636623 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.636762 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 08:57:15.636902 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.637176 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.637294 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.637504 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.637605 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.637830 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.637918 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.638152 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.638279 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.638483 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.638576 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.638802 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.638905 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.639126 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.639223 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.639446 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.639575 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.639768 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.639890 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.640030 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.640129 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.640349 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.640447 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.640668 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.640764 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845990-3-iscsi {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.641002 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.641096 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.641316 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.641411 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.641620 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.641721 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.641926 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.642029 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.642178 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.642268 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.642484 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.642594 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.642804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.642986 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.643285 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.643553 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.643687 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.643855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.643953 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.644109 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.644203 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.644429 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.644530 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.644750 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.644961 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.645082 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.645174 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.645399 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.645504 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.645704 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.645802 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.646009 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.646101 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.646315 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.646421 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.646621 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.646721 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.646925 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.647044 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845990-3-iscsi {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.647232 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.647364 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.647552 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.647681 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.647867 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.647998 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.648189 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.648412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.648522 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.648726 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.648848 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.649068 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.649215 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.649389 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.649508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.649728 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.649853 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.650038 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.650151 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.650371 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.650482 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.650692 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.650796 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.651012 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.651122 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.651330 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.651420 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.651634 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.651745 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.651942 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.652035 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.652245 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.652336 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.652565 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.652692 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.652899 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.653020 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.653208 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.653324 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.653463 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.653598 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.653765 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.653860 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.654073 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.654173 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.654393 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.654497 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.654701 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.654801 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.654963 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.655098 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.655201 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.655333 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.655527 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.655659 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.656596 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.656800 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.656968 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.657115 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.657258 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.657399 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.657549 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.657718 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.657870 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.658013 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.658167 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.658322 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.658464 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.659125 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.659296 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.659452 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.659603 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.659746 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.659901 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.660075 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.660228 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.660372 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.660528 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.660681 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.661058 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.661226 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.661379 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.661522 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.661522 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.661804 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.661804 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.662082 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.662223 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.662373 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.662530 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.662674 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.662852 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.663074 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.663239 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.663482 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.663570 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.663708 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.663806 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.663891 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.663981 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.664078 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.664163 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.664246 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.664324 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.664406 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.664495 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.664596 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.664688 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.664797 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.664883 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.664977 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.665069 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.665163 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.665236 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.665413 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.665512 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.665723 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.665827 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.666049 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.666151 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.666353 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.666452 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.666658 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.666760 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.666960 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.667047 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.667279 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.667382 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.667583 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.667688 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.667928 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.668080 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.668230 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.668370 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.668498 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.668590 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.668862 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.669018 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.669135 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.669311 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.669459 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.669681 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.669836 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.669972 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.670113 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.670258 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.670403 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.670540 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.670680 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.670820 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.670958 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.671203 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.671359 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.671501 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.671659 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.671867 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.672007 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.672154 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.672291 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.672435 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.672596 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.672749 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.672950 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.673117 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.673261 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.673361 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.673574 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.673713 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.673895 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.674057 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.674801 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.674904 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.675212 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.675543 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.675783 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.675930 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.676118 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.676254 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.676446 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.676587 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.676764 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.677021 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.677170 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.677306 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.677456 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.677599 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.677750 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.677896 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.678043 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.678193 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.678341 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.678488 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.678630 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.678784 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.678931 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.679083 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.679225 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.679370 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.679508 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.679653 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.679816 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.679959 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.680102 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.680249 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.680395 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.680550 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.680700 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.680864 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.681012 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:57:15.681152 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.681385 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.681537 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.681684 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.681831 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.681984 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.682130 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.682275 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.682416 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.682610 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.682752 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.682948 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.683091 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.683246 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.683381 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.683552 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.683854 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.683998 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.684132 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.684282 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.684384 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.684480 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.684588 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.684828 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.684938 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.685123 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.685225 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.685437 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.685542 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.685750 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.685841 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.686061 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.686153 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.686373 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.686477 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.686679 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.686778 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.686984 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.687075 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.687305 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.687447 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.687611 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.687712 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.687946 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.688035 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.688273 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.688355 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.688582 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.688671 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.688939 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.689027 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.689248 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.689338 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.689687 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.689783 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.689935 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.690016 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.690263 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.690409 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.690579 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.690718 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.690894 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.691033 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.691207 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.691344 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.691535 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.691653 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.692922 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.693188 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.693300 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.693383 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.693456 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.693526 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.693595 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.693702 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.693799 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.693883 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.693957 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.694027 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.694129 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.694212 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.694395 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.694495 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.694662 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.694829 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.695004 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.695156 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.695307 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.695450 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.695605 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.695752 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.695905 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.696051 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.696199 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.696347 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.696507 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.696648 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.696887 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.696997 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.697166 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.697314 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.697493 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.697626 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.697818 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.697936 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.698208 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.698318 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.698436 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.698529 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.698768 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.698862 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.699077 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.699169 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.699383 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.699489 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.699717 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.699832 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.700003 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.700117 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.700305 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.700415 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.700611 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.700700 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.700941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.701043 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.701245 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.701355 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.701549 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.701637 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.701868 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.701992 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.702178 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.702298 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.702480 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.702580 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.702784 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.702884 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.703090 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.703184 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.703433 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.703533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.703740 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.703832 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.704047 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.704143 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.704369 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.704470 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.704682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.704811 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.705039 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.705150 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.705909 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.706018 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.706196 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.706334 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.706503 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.706602 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.706821 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.706914 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.707134 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.707235 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.707447 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.707539 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.707769 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.707908 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.708081 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.708209 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.708402 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.708496 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.708713 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.708841 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.709090 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.709198 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.709402 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.709501 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.709723 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.709823 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.710031 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.710132 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.710341 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.710431 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.710650 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.710742 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.710962 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.711062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.711270 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.711369 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.711576 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.711690 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.711885 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.711987 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.712194 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.712330 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.712495 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.712595 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.712831 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.712926 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.713146 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.713236 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.713452 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.713563 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.713762 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.713874 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.714074 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.714187 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.714391 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.714509 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.714702 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.714800 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.715024 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.715127 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.715335 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.715443 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.715652 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.715754 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.715954 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.716048 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.716269 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.716372 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.716600 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.716700 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.716940 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.717038 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.717253 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.717363 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.717564 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.717658 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.717878 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.717971 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.718187 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.718279 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.718499 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.718598 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.718809 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.718952 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.719091 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.719181 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.719402 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.719502 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.719713 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.719814 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.720029 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.720130 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.720338 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.720446 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.720647 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.720739 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.721050 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.721673 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.721862 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.722063 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.722222 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.722393 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.722547 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.722697 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.722846 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.722994 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.723141 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.723317 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.723468 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.723635 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.723778 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.723952 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.724091 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.724281 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.724448 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.724602 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.724698 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.724905 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.725048 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.725219 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.725312 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.725539 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.725631 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.725938 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.726045 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.726176 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.726285 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.726486 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.726620 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.726810 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.726996 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.727113 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.727422 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.727754 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.727937 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.728128 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.728288 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.728435 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.728580 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.728735 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.728924 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.729072 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.729225 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.729378 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.729524 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.729669 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.729820 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.729972 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.730129 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.730274 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.730418 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.730571 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.730725 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.730878 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.731022 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.731173 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.731318 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.731469 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.731638 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.731805 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.731959 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.732103 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.732254 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.732405 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.732564 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.732719 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.732913 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.733059 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.733178 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.733267 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.733485 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.733623 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.733812 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.733910 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.734128 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.734222 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.734462 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.734635 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.734784 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.735051 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.735190 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.735387 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.735554 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.735720 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.735816 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.736036 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.736153 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.736346 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.736448 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.736701 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.736840 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.737071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.737178 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.737405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.737510 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.737789 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.737909 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.738064 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.738204 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.738386 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.738487 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.738711 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.738804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.739032 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.739143 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.739385 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.739477 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.739660 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.739745 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.739994 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.740099 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.740279 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.740371 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.740591 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.740701 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.740923 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.741030 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.741234 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.741341 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.741546 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.741677 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.741860 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.741968 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.742176 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.742273 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.742498 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.742614 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.742805 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.742915 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.743125 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.743238 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.743436 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.743533 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.743746 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.743843 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.744151 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.744303 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.744560 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.744717 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.745000 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.745123 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.745225 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.745304 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.745397 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.745613 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.745708 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.745966 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.746068 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.746255 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.746372 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.746580 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.746680 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.746917 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.747015 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.747249 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.747342 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.747580 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.747679 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.747888 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.747994 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.748197 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.748289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.748506 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.748604 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.748834 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.748930 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.749142 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.749235 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.749469 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.749564 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.749761 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.749860 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.750069 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.750158 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.750376 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.750481 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.750682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.750771 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.750987 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.751078 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.751294 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.751398 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.751665 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.751749 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.751910 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.752045 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.752214 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.752371 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.752598 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.752760 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.752942 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.753109 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.753293 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.753421 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.753580 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.753715 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.753889 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.754026 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.754198 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.754332 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.754509 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.754656 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.754856 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.754972 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.755237 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.755321 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.755496 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.755586 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.755831 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.755932 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.756142 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.756230 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.756841 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.756998 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.757131 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.757326 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.757444 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.757566 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.757686 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.757799 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.757921 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.758049 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.758163 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.758275 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.758394 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.758514 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.758644 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.758767 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.758888 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.759001 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.759167 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.759296 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.759485 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.759585 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.759793 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.759886 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.760103 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.760202 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.760409 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.760510 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.760716 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.760841 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.761048 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.761143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.761358 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.761460 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.761665 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.761771 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.761970 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.762064 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.762274 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.762376 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.762580 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.762671 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.762883 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.762976 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.763189 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.763284 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.763538 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.763656 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.763805 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.763905 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.764110 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.764206 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.764417 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.764507 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.764878 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.765005 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.765095 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.765189 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.765359 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.765459 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.766128 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.766256 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.766355 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.766443 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.766528 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.766631 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.766883 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.766992 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.767088 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.767175 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.767270 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.767493 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.767614 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.767717 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.767810 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.768446 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.769259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.769359 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.769359 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.769359 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.769618 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.769750 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.769948 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.770094 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.770265 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.770424 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.770581 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.770737 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.770906 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.771058 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.771232 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.771371 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.771559 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.771683 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.771867 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.771993 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.772180 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.772305 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.772541 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.772823 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.773140 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.773451 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.773681 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.773789 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.774020 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.774121 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.774345 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.774449 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.774666 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.774774 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.775029 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.775128 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.775274 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.775377 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.775645 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.775752 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.775889 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.775992 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.776204 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.776318 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.776522 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.776615 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.778216 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.778338 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.778448 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.778548 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.778637 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.778722 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.778722 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.778896 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.778997 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.779084 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.779168 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.779260 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.779260 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.779430 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.779526 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.779620 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.779714 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.779800 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.779892 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.779986 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.780081 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.780176 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.780385 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.780499 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.780762 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.780895 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.780985 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.781071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.781276 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.781380 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.781606 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.781829 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.781929 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.782080 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.782230 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.782393 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.782558 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.782705 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.782889 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.783012 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.783220 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.783312 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.783600 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.784226 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.784547 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.784650 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.785164 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.785272 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.785376 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.785464 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.785549 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.785789 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.785895 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.786016 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.786119 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.786445 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.786558 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.786846 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.786981 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.787082 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.787183 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.787299 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.787420 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.787639 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.787815 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.787921 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.788130 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.788224 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.788444 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.788545 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.788771 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.788909 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.789118 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.789211 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.789446 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.789539 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.789752 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.789854 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.790068 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.790166 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.790379 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.790472 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.790693 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.790797 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.791006 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.791098 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.791316 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.791448 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.791633 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.791760 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.791940 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.792078 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.792268 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.792392 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.792594 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.792694 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.792939 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.796102 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.796198 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.796307 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.796307 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.796483 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.796575 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.796659 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.796659 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.796883 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.796987 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.797082 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.797167 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.797249 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.797332 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.797423 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.797568 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.797663 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.797761 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.797855 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.797952 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.798038 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.798124 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.798216 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.798300 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.798391 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.798481 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.798576 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.798693 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.798783 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.798864 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.798936 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.799027 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.799146 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.799248 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.799334 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.799406 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.799486 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.799559 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.799637 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.799737 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.799829 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.799929 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.799929 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.800101 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.800194 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.800279 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.800363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.800446 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.800659 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.800821 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.801008 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.801103 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.801319 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.801457 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.801648 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.801742 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.801956 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.802085 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.802281 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.802407 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.802609 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.802731 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.802922 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.803040 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.803293 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.803594 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.803906 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.804041 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.804238 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.804365 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.804591 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.804733 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.804906 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.805022 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.805235 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.805377 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.805660 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.805790 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.806003 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.806131 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.806292 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.806418 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.806638 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.806809 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.806932 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.807033 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.807217 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.807310 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.807529 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.807668 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.807835 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.807969 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.808143 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.808284 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.808452 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.808597 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.808765 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.808998 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.809277 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.809597 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.809915 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.810235 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.810546 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.810858 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.811187 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.811498 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.811827 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.812146 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.812477 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.812824 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.813175 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.813536 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.813677 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.813792 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.813910 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.814107 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.814274 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.814407 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.814521 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.814824 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.814957 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.815340 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.815472 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.815881 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.816000 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.816245 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.816387 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.816631 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.816770 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.819244 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.819461 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.819461 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.820044 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.820200 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.820200 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.820503 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.820663 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.820929 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.821103 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.821373 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.821549 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.821749 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.821903 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.822071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.822230 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.822423 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.822578 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.822728 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.822918 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.823080 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.823230 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.823460 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.823621 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.823779 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.823930 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.823930 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.824363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.824525 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.824675 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.824957 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.825129 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.825280 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.825438 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.825602 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.825787 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.826060 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.826778 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.826940 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.827101 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.827277 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.827429 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.827586 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.827586 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.827992 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.828161 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.828320 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.828472 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.828472 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.828825 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.829066 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.829233 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.829233 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.829543 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.829693 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.829917 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.830076 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.830237 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.830237 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.831184 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.831342 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.831642 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.831817 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.831817 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.831817 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.832303 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.832453 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.832453 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.832755 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.832938 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.833120 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.833274 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.833435 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.833586 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.833745 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.833896 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.834045 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.834216 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.834369 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.834369 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.834673 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.834838 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.835096 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.835302 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.835462 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.835462 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.835761 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.835922 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.836198 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.836367 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.836526 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.836686 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.836967 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.837127 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.837310 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.837465 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.837625 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.837782 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.837932 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.838087 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.838240 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.838397 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.838571 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.838729 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.838880 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.839055 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.839276 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.839474 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.839474 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.839775 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.839933 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.839933 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.840235 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.840393 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.840560 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.840712 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.840712 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.841050 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.841224 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.841487 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.841645 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.841803 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.841953 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.842109 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.842269 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.842426 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.842594 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.843319 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.843484 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.843484 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.843706 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.843818 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.843818 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.844030 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.844142 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.844252 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.844372 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.844483 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.844593 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.844710 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.844843 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.844961 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.847848 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.848027 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.848189 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.848189 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.848492 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.848650 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.848840 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.849007 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.849160 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.849160 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.849586 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.849825 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.850023 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.850187 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.850341 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.850497 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.850648 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.850648 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.850985 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.851143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.851301 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.851478 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.851734 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.851734 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.852048 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.852048 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.852048 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.852470 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.852628 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.852795 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.852953 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.853102 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.853252 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.853401 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.853620 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.853620 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.853921 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.854080 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.854230 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.854379 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.854595 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.854803 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.854960 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.854960 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.855329 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.855501 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.855659 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.855859 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.856018 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.856170 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.856319 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.856483 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.856641 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.856940 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.857115 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.857438 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.857722 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.857898 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.858051 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.858211 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.858361 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.858512 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.858661 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.858928 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.859085 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.859085 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.859440 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.859660 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.859825 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.859825 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.860158 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.860328 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.860490 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.860648 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.860825 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.860993 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.861144 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.861292 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.861441 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.861589 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.862016 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.862179 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.862337 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.862495 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.862645 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.862807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.863001 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.863001 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.863303 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.863460 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.863610 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.863773 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.863960 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.864115 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.864278 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.864437 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.864587 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.864848 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.864848 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.865204 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.865204 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.865589 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.865822 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.865989 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.866141 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.866290 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.866448 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.866599 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.866599 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.866947 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.867180 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.868374 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.868542 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.868695 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.868887 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.869235 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.869393 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.869543 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.869760 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.869916 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.870082 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.870082 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.870443 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.870603 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.870761 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.870924 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.871075 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.871295 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.871488 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.871611 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.871718 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.871837 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.871959 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.872052 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.872137 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.872221 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.872221 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.872221 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.872221 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.872221 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.872221 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.872724 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.893514 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.893514 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.893853 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.893970 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.894082 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.894202 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.894331 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.894452 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.894564 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.894683 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.894683 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.894901 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.895021 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.895140 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.895253 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.895371 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.895482 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.895592 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.895716 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.895836 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.895948 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.896058 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.896169 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.896289 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.896401 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.896511 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.896622 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.896622 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.896856 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.896856 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.897094 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.897094 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.897311 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.897423 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.897568 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.897698 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.897930 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.898142 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.898274 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.898414 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.898639 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.898830 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.898958 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.899070 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.899180 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.899291 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.899432 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.899613 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.899807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.899922 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.900042 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.900154 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.900421 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.900546 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.900657 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.900657 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.900922 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.901059 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.901185 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.901185 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.901185 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.901534 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.901534 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.901751 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.901751 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.902039 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.902158 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.902270 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.902380 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.902507 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.902650 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.902777 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.902888 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.903047 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.903174 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.903286 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.903404 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.903622 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.903741 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.903860 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.904012 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.904132 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.904252 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.904372 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.904483 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.904601 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.904728 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.904864 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.904978 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.905123 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.905237 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.905361 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.905486 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.905641 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.905764 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.905883 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.906002 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.906138 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.906250 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.906366 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.906476 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.906586 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.906742 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.906947 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.907069 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.907222 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.907343 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.907463 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.907582 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.907848 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.908075 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.908303 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.908426 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.909352 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.909478 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.909625 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.909829 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.909958 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.910148 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.910287 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.910514 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.910642 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.910754 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.910865 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.910975 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.911088 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.911212 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.911334 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.911490 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.911616 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.911728 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.911839 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.911958 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.912080 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.912193 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.912303 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.912413 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.912531 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.912656 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.912837 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.912977 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.913091 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.913208 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.913329 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.913447 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.913636 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.913756 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.913868 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.913986 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.914117 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.914236 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.914347 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.914463 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.914635 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.914766 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.914887 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.915006 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.915118 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.915229 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.915339 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.915458 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.915605 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.915760 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.915884 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.915995 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.916139 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.916269 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.919021 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.919155 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.919271 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.919666 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.919840 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.920079 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.920200 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.920313 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.920425 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.920645 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.920764 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.920970 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.921085 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.921204 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.921324 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.921445 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.921567 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.921708 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.921842 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.922016 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.922131 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.922241 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.922362 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.922474 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.922585 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.922742 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.922742 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.923035 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.923157 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.923278 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.923390 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.923390 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.923605 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.923726 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.923882 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.923882 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.925858 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.927319 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.927460 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.927589 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.927705 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.927816 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.927953 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.928111 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.928259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.928386 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.928500 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.928622 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.928756 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.929166 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.929302 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.929422 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.929564 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.929564 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.930031 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.930288 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.930415 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.930528 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 08:57:15.930667 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.930667 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.930667 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.930667 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.930667 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:57:15.930667 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 08:57:15.969794 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO dbcounter [None req-bcdd89f4-2982-45fc-a911-b037a36b8c45 None None] Registered counter for database nova_api Jun 22 08:57:15.972189 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO dbcounter [None req-92af597e-5f8f-4969-abaa-f1e0adf58927 None None] Registered counter for database nova_api Jun 22 08:57:15.991346 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_db.sqlalchemy.engines [None req-bcdd89f4-2982-45fc-a911-b037a36b8c45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118024) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:57:15.992841 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_db.sqlalchemy.engines [None req-92af597e-5f8f-4969-abaa-f1e0adf58927 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118025) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:57:15.999460 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writer thread running {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:57:15.999695 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writer thread running {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:57:16.057623 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.context [None req-92af597e-5f8f-4969-abaa-f1e0adf58927 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5ad901b7-3900-406f-b273-6ca9cc1c0d47(cell1) {{(pid=118025) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 08:57:16.057864 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.context [None req-bcdd89f4-2982-45fc-a911-b037a36b8c45 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5ad901b7-3900-406f-b273-6ca9cc1c0d47(cell1) {{(pid=118024) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 08:57:16.061766 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bcdd89f4-2982-45fc-a911-b037a36b8c45 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:57:16.061883 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-92af597e-5f8f-4969-abaa-f1e0adf58927 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:57:16.063361 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bcdd89f4-2982-45fc-a911-b037a36b8c45 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:57:16.063490 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-92af597e-5f8f-4969-abaa-f1e0adf58927 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:57:16.064181 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bcdd89f4-2982-45fc-a911-b037a36b8c45 None None] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:57:16.064287 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-92af597e-5f8f-4969-abaa-f1e0adf58927 None None] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:57:16.066680 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bcdd89f4-2982-45fc-a911-b037a36b8c45 None None] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:57:16.069331 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-92af597e-5f8f-4969-abaa-f1e0adf58927 None None] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:57:16.069477 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO dbcounter [None req-bcdd89f4-2982-45fc-a911-b037a36b8c45 None None] Registered counter for database nova_cell0 Jun 22 08:57:16.069569 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO dbcounter [None req-92af597e-5f8f-4969-abaa-f1e0adf58927 None None] Registered counter for database nova_cell0 Jun 22 08:57:16.073069 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO dbcounter [None req-bcdd89f4-2982-45fc-a911-b037a36b8c45 None None] Registered counter for database nova_cell1 Jun 22 08:57:16.073941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO dbcounter [None req-92af597e-5f8f-4969-abaa-f1e0adf58927 None None] Registered counter for database nova_cell1 Jun 22 08:57:16.080237 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_db.sqlalchemy.engines [None req-bcdd89f4-2982-45fc-a911-b037a36b8c45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118024) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:57:16.082395 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_db.sqlalchemy.engines [None req-bcdd89f4-2982-45fc-a911-b037a36b8c45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118024) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:57:16.085940 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_db.sqlalchemy.engines [None req-92af597e-5f8f-4969-abaa-f1e0adf58927 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118025) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:57:16.087584 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_db.sqlalchemy.engines [None req-92af597e-5f8f-4969-abaa-f1e0adf58927 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118025) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:57:16.089292 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writer thread running {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:57:16.090594 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writer thread running {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:57:16.093905 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writer thread running {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:57:16.095222 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writer thread running {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:57:16.238439 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO dbcounter [None req-bcdd89f4-2982-45fc-a911-b037a36b8c45 None None] Registered counter for database nova_cell0 Jun 22 08:57:16.244208 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO dbcounter [None req-92af597e-5f8f-4969-abaa-f1e0adf58927 None None] Registered counter for database nova_cell0 Jun 22 08:57:16.245160 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_db.sqlalchemy.engines [None req-bcdd89f4-2982-45fc-a911-b037a36b8c45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118024) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:57:16.249582 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writer thread running {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:57:16.250713 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_db.sqlalchemy.engines [None req-92af597e-5f8f-4969-abaa-f1e0adf58927 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118025) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:57:16.255910 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writer thread running {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:57:16.572118 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: WARNING keystonemiddleware.auth_token [None req-bcdd89f4-2982-45fc-a911-b037a36b8c45 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 08:57:16.576728 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: WARNING keystonemiddleware.auth_token [None req-92af597e-5f8f-4969-abaa-f1e0adf58927 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 08:57:16.579494 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: WARNING keystonemiddleware.auth_token [None req-bcdd89f4-2982-45fc-a911-b037a36b8c45 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 08:57:16.584169 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: WARNING keystonemiddleware.auth_token [None req-92af597e-5f8f-4969-abaa-f1e0adf58927 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 08:57:16.925531 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: WARNING keystonemiddleware.auth_token [None req-bcdd89f4-2982-45fc-a911-b037a36b8c45 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 08:57:16.926268 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: WARNING keystonemiddleware.auth_token [None req-92af597e-5f8f-4969-abaa-f1e0adf58927 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 08:57:16.931780 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: WARNING keystonemiddleware.auth_token [None req-bcdd89f4-2982-45fc-a911-b037a36b8c45 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 08:57:16.934099 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: WARNING keystonemiddleware.auth_token [None req-92af597e-5f8f-4969-abaa-f1e0adf58927 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 08:57:16.937341 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564d611cb9c0 pid: 118024 (default app) Jun 22 08:57:16.937662 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564d611cb9c0 pid: 118025 (default app) Jun 22 08:57:58.223170 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=3 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:57:58.226008 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell0:SELECT=3 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:57:58.227033 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=3 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:57:58.229735 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell0:SELECT=3 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:57:59.638216 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6263baa3-b2ae-4a17-852b-06de8fbf4135 tempest-VolumesGetTestJSON-1143222373 tempest-VolumesGetTestJSON-1143222373-project] Action: 'create', calling method: .version_select at 0x7f57581b5790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-555707415", "metadata": {"Type": "work"}}} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:58:01.760674 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-6263baa3-b2ae-4a17-852b-06de8fbf4135 tempest-VolumesGetTestJSON-1143222373 tempest-VolumesGetTestJSON-1143222373-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.558884 Jun 22 08:58:01.762282 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1155 bytes} [Wed Jun 22 08:57:58 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3562 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 22 08:58:01.777133 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=3 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:58:01.780134 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell0:SELECT=3 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:58:01.781971 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=3 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:58:01.790037 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell0:SELECT=3 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:58:02.110736 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-fa74b732-03b3-4a15-a8a4-252af6d6638d tempest-VolumesGetTestJSON-1143222373 tempest-VolumesGetTestJSON-1143222373-project] Calling method '.version_select at 0x7f5758203280>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:02.710297 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-fa74b732-03b3-4a15-a8a4-252af6d6638d tempest-VolumesGetTestJSON-1143222373 tempest-VolumesGetTestJSON-1143222373-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/8154df4d-b5a3-4858-96cc-d627b12ee331" status: 200 len: 352 microversion: 2.1 time: 0.939358 Jun 22 08:58:02.711123 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 1/2] 10.222.0.16 () {58 vars in 1244 bytes} [Wed Jun 22 08:58:01 2022] GET /compute/v2.1/os-volumes/8154df4d-b5a3-4858-96cc-d627b12ee331 => generated 352 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:58:03.727046 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ed57854b-110e-4b1e-acfe-f896d679b428 tempest-VolumesGetTestJSON-1143222373 tempest-VolumesGetTestJSON-1143222373-project] Calling method '.version_select at 0x7f575807e5e0>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:03.881796 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ed57854b-110e-4b1e-acfe-f896d679b428 tempest-VolumesGetTestJSON-1143222373 tempest-VolumesGetTestJSON-1143222373-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/8154df4d-b5a3-4858-96cc-d627b12ee331" status: 200 len: 353 microversion: 2.1 time: 0.159052 Jun 22 08:58:03.882657 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1244 bytes} [Wed Jun 22 08:58:03 2022] GET /compute/v2.1/os-volumes/8154df4d-b5a3-4858-96cc-d627b12ee331 => generated 353 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:58:03.907512 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-08244d1e-d22b-427d-a462-4b74e25f6613 tempest-VolumesGetTestJSON-1143222373 tempest-VolumesGetTestJSON-1143222373-project] Calling method '.version_select at 0x7f57580c9820>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:04.023888 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-08244d1e-d22b-427d-a462-4b74e25f6613 tempest-VolumesGetTestJSON-1143222373 tempest-VolumesGetTestJSON-1143222373-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/8154df4d-b5a3-4858-96cc-d627b12ee331" status: 200 len: 353 microversion: 2.1 time: 0.125756 Jun 22 08:58:04.024741 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1244 bytes} [Wed Jun 22 08:58:03 2022] GET /compute/v2.1/os-volumes/8154df4d-b5a3-4858-96cc-d627b12ee331 => generated 353 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:58:04.038186 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-307b6a22-32c0-4ff2-b411-1f915220194d tempest-VolumesGetTestJSON-1143222373 tempest-VolumesGetTestJSON-1143222373-project] Calling method '.version_select at 0x7f575807e700>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:04.312181 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-307b6a22-32c0-4ff2-b411-1f915220194d tempest-VolumesGetTestJSON-1143222373 tempest-VolumesGetTestJSON-1143222373-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/8154df4d-b5a3-4858-96cc-d627b12ee331" status: 202 len: 0 microversion: 2.1 time: 0.278336 Jun 22 08:58:04.313161 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 3/5] 10.222.0.16 () {58 vars in 1247 bytes} [Wed Jun 22 08:58:04 2022] DELETE /compute/v2.1/os-volumes/8154df4d-b5a3-4858-96cc-d627b12ee331 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 08:58:04.321441 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a6dd8a5a-7127-4a85-a250-ba4a7db6219a tempest-VolumesGetTestJSON-1143222373 tempest-VolumesGetTestJSON-1143222373-project] Calling method '.version_select at 0x7f57580c9430>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:04.404639 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a6dd8a5a-7127-4a85-a250-ba4a7db6219a tempest-VolumesGetTestJSON-1143222373 tempest-VolumesGetTestJSON-1143222373-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/8154df4d-b5a3-4858-96cc-d627b12ee331" status: 200 len: 352 microversion: 2.1 time: 0.086584 Jun 22 08:58:04.409799 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 3/6] 10.222.0.16 () {58 vars in 1244 bytes} [Wed Jun 22 08:58:04 2022] GET /compute/v2.1/os-volumes/8154df4d-b5a3-4858-96cc-d627b12ee331 => generated 352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:58:05.417270 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ec82261e-c2ed-4ce2-b74c-02ce04bd39eb tempest-VolumesGetTestJSON-1143222373 tempest-VolumesGetTestJSON-1143222373-project] Calling method '.version_select at 0x7f575807ed30>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:05.504158 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.wsgi [None req-ec82261e-c2ed-4ce2-b74c-02ce04bd39eb tempest-VolumesGetTestJSON-1143222373 tempest-VolumesGetTestJSON-1143222373-project] HTTP exception thrown: Volume 8154df4d-b5a3-4858-96cc-d627b12ee331 could not be found. Jun 22 08:58:05.511090 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ec82261e-c2ed-4ce2-b74c-02ce04bd39eb tempest-VolumesGetTestJSON-1143222373 tempest-VolumesGetTestJSON-1143222373-project] Request method failure captured: Jun 22 08:58:05.511090 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: request: GET /compute/v2.1/os-volumes/8154df4d-b5a3-4858-96cc-d627b12ee331 HTTP/1.1 Jun 22 08:58:05.511090 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept: application/json Jun 22 08:58:05.511090 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept-Encoding: identity Jun 22 08:58:05.511090 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Connection: close Jun 22 08:58:05.511090 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Length: 0 Jun 22 08:58:05.511090 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Type: application/json Jun 22 08:58:05.511090 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Host: 10.222.0.16 Jun 22 08:58:05.511090 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Openstack-System-Scope: None Jun 22 08:58:05.511090 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: User-Agent: python-urllib3/1.26.9 Jun 22 08:58:05.511090 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Auth-Token: gAAAAABistmWGt4HhJxJHwy7Q7ZjDgBSdee11TI7sg87UkWtSpT3jt1XMwqnfqhSh_fYBq8i3wnvI8nr9o5u1N0s0OsUHPQFW0v0jJSpORD8Ew0Xv19lCaaPNmk8Gei1ZyfbxIs7hk7lGJJI8PeFZORXR1_rWpNKoyYIXfgP9E4GydeA_dGiNho Jun 22 08:58:05.511090 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Id: None Jun 22 08:58:05.511090 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Name: None Jun 22 08:58:05.511090 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Identity-Status: Confirmed Jun 22 08:58:05.511090 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Is-Admin-Project: True Jun 22 08:58:05.511090 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Id: default Jun 22 08:58:05.511090 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Name: Default Jun 22 08:58:05.511090 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Id: ea8e7ffa5f3e4a35b1d9deb7488dd03a Jun 22 08:58:05.511090 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Name: tempest-VolumesGetTestJSON-1143222373 Jun 22 08:58:05.511090 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Role: member,reader Jun 22 08:58:05.511090 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Roles: member,reader Jun 22 08:58:05.512390 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ea8e7ffa5f3e4a35b1d9deb7488dd03a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ea8e7ffa5f3e4a35b1d9deb7488dd03a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ea8e7ffa5f3e4a35b1d9deb7488dd03a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ea8e7ffa5f3e4a35b1d9deb7488dd03a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 08:58:05.512390 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant: tempest-VolumesGetTestJSON-1143222373 Jun 22 08:58:05.512390 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Id: ea8e7ffa5f3e4a35b1d9deb7488dd03a Jun 22 08:58:05.512390 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Name: tempest-VolumesGetTestJSON-1143222373 Jun 22 08:58:05.512390 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User: tempest-VolumesGetTestJSON-1143222373-project Jun 22 08:58:05.512390 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Id: default Jun 22 08:58:05.512390 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Name: Default Jun 22 08:58:05.512390 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Id: 59e22f65d9e948c6924051bed9b160eb Jun 22 08:58:05.512390 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Name: tempest-VolumesGetTestJSON-1143222373-project Jun 22 08:58:05.512390 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: method: Jun 22 08:58:05.512390 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: exception: Volume 8154df4d-b5a3-4858-96cc-d627b12ee331 could not be found. Jun 22 08:58:05.512390 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: action_args: {'id': '8154df4d-b5a3-4858-96cc-d627b12ee331'} Jun 22 08:58:05.512390 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 08:58:05.513224 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:58:05.513224 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 08:58:05.513224 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 08:58:05.513224 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 08:58:05.513224 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 08:58:05.513224 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 08:58:05.513224 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 08:58:05.513224 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 08:58:05.513224 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 08:58:05.513224 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 08:58:05.513224 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 08:58:05.513224 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 08:58:05.513224 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 08:58:05.513224 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 08:58:05.513224 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 08:58:05.513224 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8154df4d-b5a3-4858-96cc-d627b12ee331 could not be found. (HTTP 404) (Request-ID: req-03144d22-9218-4246-a79b-6c0b1766f995) Jun 22 08:58:05.513224 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 08:58:05.513224 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 08:58:05.513224 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 08:58:05.515086 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:58:05.515086 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 08:58:05.515086 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 08:58:05.515086 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 08:58:05.515086 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 08:58:05.515086 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 08:58:05.515086 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 08:58:05.515086 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 08:58:05.515086 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 08:58:05.515086 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 08:58:05.515086 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 08:58:05.515086 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 08:58:05.515086 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 08:58:05.515086 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 08:58:05.515086 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 08:58:05.515086 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 08:58:05.515086 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 08:58:05.515086 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 08:58:05.515086 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 08:58:05.516148 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 08:58:05.516148 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 08:58:05.516148 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 08:58:05.516148 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 08:58:05.516148 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8154df4d-b5a3-4858-96cc-d627b12ee331 could not be found. Jun 22 08:58:05.516148 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 08:58:05.516148 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 08:58:05.516148 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 08:58:05.516148 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:58:05.516148 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 08:58:05.516148 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 08:58:05.516148 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 08:58:05.516148 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 08:58:05.516148 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 08:58:05.516148 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 08:58:05.516148 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 08:58:05.516148 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 08:58:05.516148 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 08:58:05.516148 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 08:58:05.517641 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8154df4d-b5a3-4858-96cc-d627b12ee331 could not be found. Jun 22 08:58:05.517641 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 08:58:05.517641 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 08:58:05.517641 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 08:58:05.517641 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:58:05.517641 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 08:58:05.517641 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 08:58:05.517641 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 08:58:05.517641 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 08:58:05.517641 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8154df4d-b5a3-4858-96cc-d627b12ee331 could not be found. Jun 22 08:58:05.517641 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 08:58:05.517641 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ec82261e-c2ed-4ce2-b74c-02ce04bd39eb tempest-VolumesGetTestJSON-1143222373 tempest-VolumesGetTestJSON-1143222373-project] Returning 404 to user: Volume 8154df4d-b5a3-4858-96cc-d627b12ee331 could not be found. {{(pid=118024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 08:58:05.517641 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ec82261e-c2ed-4ce2-b74c-02ce04bd39eb tempest-VolumesGetTestJSON-1143222373 tempest-VolumesGetTestJSON-1143222373-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/8154df4d-b5a3-4858-96cc-d627b12ee331" status: 404 len: 109 microversion: 2.1 time: 0.097749 Jun 22 08:58:05.524329 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1244 bytes} [Wed Jun 22 08:58:05 2022] GET /compute/v2.1/os-volumes/8154df4d-b5a3-4858-96cc-d627b12ee331 => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 08:58:12.904564 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-2e36a1b0-fdc5-493f-9511-a16c057e8809 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-255753471", "imageRef": "c24d36a8-7909-4174-9b12-42c8d76647ac", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:58:13.085763 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.network.neutron [None req-2e36a1b0-fdc5-493f-9511-a16c057e8809 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] validate_networks() for [('e60d8203-b0b0-4095-acaa-80276076a1ac', None, None, None, None, None)] {{(pid=118024) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 08:58:13.116160 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-dee16d8d-b408-41fa-a282-526fd9f45a61 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Action: 'create', calling method: .version_select at 0x7f57580c9e50>, body: {"keypair": {"name": "tempest-keypair-1306165953", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMyXObWFBMHcULrQmIPgjLrF1UdKKzlcgTXN+hnSRMv5UR/RU6onlLT3a7vHQfG0rSI9SIpt7aesVa4cBj++zWMNuMucuk5lWnpOMCJNb8NgLwF4uCQuT6tsvkbigQc4ew=="}} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:58:13.176477 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.quota [None req-dee16d8d-b408-41fa-a282-526fd9f45a61 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Getting quotas for project 175a336dc3fd44c2ae20e51b46d423e4. Resources: {'key_pairs'} {{(pid=118025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 08:58:13.183177 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.quota [None req-dee16d8d-b408-41fa-a282-526fd9f45a61 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Getting quotas for user 566b001b7a504fadb85ad04ea1be22f2 and project 175a336dc3fd44c2ae20e51b46d423e4. Resources: {'key_pairs'} {{(pid=118025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 08:58:13.343413 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-dee16d8d-b408-41fa-a282-526fd9f45a61 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.816724 Jun 22 08:58:13.344764 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 4/8] 10.222.0.16 () {60 vars in 1158 bytes} [Wed Jun 22 08:58:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:58:15.033119 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-de039ee9-eeb3-46a2-b854-72e3b5f5e764 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-775186268", "imageRef": "c24d36a8-7909-4174-9b12-42c8d76647ac", "flavorRef": "452", "networks": [{"uuid": "42875005-f842-45b5-b26f-190327c28278"}]}} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:58:15.201712 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.network.neutron [None req-de039ee9-eeb3-46a2-b854-72e3b5f5e764 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] validate_networks() for [('42875005-f842-45b5-b26f-190327c28278', None, None, None, None, None)] {{(pid=118025) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 08:58:16.527953 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-2e36a1b0-fdc5-493f-9511-a16c057e8809 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Flavor limits 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 08:58:16.528421 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-2e36a1b0-fdc5-493f-9511-a16c057e8809 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Image limits 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 08:58:16.530194 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-2e36a1b0-fdc5-493f-9511-a16c057e8809 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Flavor pref 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 08:58:16.530377 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-2e36a1b0-fdc5-493f-9511-a16c057e8809 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Image pref 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 08:58:16.530979 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-2e36a1b0-fdc5-493f-9511-a16c057e8809 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 08:58:16.557812 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2e36a1b0-fdc5-493f-9511-a16c057e8809 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:16.569850 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2e36a1b0-fdc5-493f-9511-a16c057e8809 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:16.570925 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2e36a1b0-fdc5-493f-9511-a16c057e8809 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:16.571354 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2e36a1b0-fdc5-493f-9511-a16c057e8809 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:16.643875 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.quota [None req-2e36a1b0-fdc5-493f-9511-a16c057e8809 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Getting quotas for project 4019eed8f0a140f099ca1c123ff71cef. Resources: {'cores', 'instances', 'ram'} {{(pid=118024) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 08:58:16.662138 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.quota [None req-2e36a1b0-fdc5-493f-9511-a16c057e8809 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Getting quotas for user 1a8d3cd247d743cf8c93ee15d8574602 and project 4019eed8f0a140f099ca1c123ff71cef. Resources: {'cores', 'instances', 'ram'} {{(pid=118024) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 08:58:16.697860 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-2e36a1b0-fdc5-493f-9511-a16c057e8809 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Going to run 1 instances... {{(pid=118024) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 08:58:16.702464 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-2e36a1b0-fdc5-493f-9511-a16c057e8809 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c24d36a8-7909-4174-9b12-42c8d76647ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118024) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 08:58:17.064836 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-2e36a1b0-fdc5-493f-9511-a16c057e8809 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.479524 Jun 22 08:58:17.070121 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 5/9] 10.222.0.16 () {60 vars in 1146 bytes} [Wed Jun 22 08:58:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 4486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 08:58:17.077999 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f4fffc48-14dd-449a-b85a-82821de542a3 tempest-VolumesTestJSON-685582747 tempest-VolumesTestJSON-685582747-project] Calling method '.version_select at 0x7f57576ff1f0>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:17.226527 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f4fffc48-14dd-449a-b85a-82821de542a3 tempest-VolumesTestJSON-685582747 tempest-VolumesTestJSON-685582747-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/e7e5988d-9457-474f-b64c-cefeadcd0ef9" status: 200 len: 350 microversion: 2.1 time: 0.154773 Jun 22 08:58:17.232804 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 6/10] 10.222.0.16 () {58 vars in 1244 bytes} [Wed Jun 22 08:58:17 2022] GET /compute/v2.1/os-volumes/e7e5988d-9457-474f-b64c-cefeadcd0ef9 => generated 350 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:58:17.232804 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b39487ca-2266-431c-a625-11d0747d91b5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:17.235682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-b39487ca-2266-431c-a625-11d0747d91b5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:17.648891 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-b39487ca-2266-431c-a625-11d0747d91b5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:17.693368 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-b39487ca-2266-431c-a625-11d0747d91b5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1221 microversion: 2.1 time: 0.460594 Jun 22 08:58:17.694366 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 7/11] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:17 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1221 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:17.944075 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-828f50e1-cb6b-406b-81f4-c58cd26f2331 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2144439007", "imageRef": "c24d36a8-7909-4174-9b12-42c8d76647ac", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:58:18.078251 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.network.neutron [None req-828f50e1-cb6b-406b-81f4-c58cd26f2331 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] validate_networks() for [('e60d8203-b0b0-4095-acaa-80276076a1ac', None, None, None, None, None)] {{(pid=118024) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 08:58:18.638173 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-de039ee9-eeb3-46a2-b854-72e3b5f5e764 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Flavor limits 0:0:0 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 08:58:18.638701 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-de039ee9-eeb3-46a2-b854-72e3b5f5e764 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Image limits 0:0:0 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 08:58:18.639602 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-de039ee9-eeb3-46a2-b854-72e3b5f5e764 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Flavor pref 0:0:0 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 08:58:18.640104 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-de039ee9-eeb3-46a2-b854-72e3b5f5e764 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Image pref 0:0:0 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 08:58:18.640531 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-de039ee9-eeb3-46a2-b854-72e3b5f5e764 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 08:58:18.662316 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-de039ee9-eeb3-46a2-b854-72e3b5f5e764 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:18.662777 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-de039ee9-eeb3-46a2-b854-72e3b5f5e764 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:18.674007 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-de039ee9-eeb3-46a2-b854-72e3b5f5e764 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:18.674482 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-de039ee9-eeb3-46a2-b854-72e3b5f5e764 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:18.763784 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.quota [None req-de039ee9-eeb3-46a2-b854-72e3b5f5e764 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Getting quotas for project 2c5502a8e1c8480aa5e683c73b112064. Resources: {'cores', 'instances', 'ram'} {{(pid=118025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 08:58:18.780970 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.quota [None req-de039ee9-eeb3-46a2-b854-72e3b5f5e764 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Getting quotas for user c0d27459025c40c5acdfd284ab338b1e and project 2c5502a8e1c8480aa5e683c73b112064. Resources: {'cores', 'instances', 'ram'} {{(pid=118025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 08:58:18.851457 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-de039ee9-eeb3-46a2-b854-72e3b5f5e764 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Going to run 1 instances... {{(pid=118025) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 08:58:18.863019 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-de039ee9-eeb3-46a2-b854-72e3b5f5e764 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c24d36a8-7909-4174-9b12-42c8d76647ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 08:58:19.150604 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-de039ee9-eeb3-46a2-b854-72e3b5f5e764 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.363123 Jun 22 08:58:19.152065 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 5/12] 10.222.0.16 () {60 vars in 1146 bytes} [Wed Jun 22 08:58:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 4365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 08:58:19.662948 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a4e60287-2cc3-40e0-b6da-2c80e9199fc4 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Action: 'create', calling method: .version_select at 0x7f5757735550>, body: {"keypair": {"name": "tempest-keypair-1053939892", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxWDMS4nGrnIFLi9/EpqLp5PjP7rYedijRnpTcKjjD3i3vdZE2LI7dLOyk9lL9vrupX5yp0kV+iXQ1kaNjveuz6n6YRRCfqLSX5Q+AwkMmG+v9tcVOTD4FCKjKUW5eSrg=="}} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:58:19.720978 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.quota [None req-a4e60287-2cc3-40e0-b6da-2c80e9199fc4 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Getting quotas for project 9ebdcb9809a84f25bd578f8aca09802c. Resources: {'key_pairs'} {{(pid=118025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 08:58:19.731914 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.quota [None req-a4e60287-2cc3-40e0-b6da-2c80e9199fc4 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Getting quotas for user 71ea2610ccc044de9d66444b4038fe9e and project 9ebdcb9809a84f25bd578f8aca09802c. Resources: {'key_pairs'} {{(pid=118025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 08:58:19.942963 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a4e60287-2cc3-40e0-b6da-2c80e9199fc4 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.789179 Jun 22 08:58:19.944008 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 6/13] 10.222.0.16 () {60 vars in 1158 bytes} [Wed Jun 22 08:58:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:58:19.951244 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d6586a8e-2211-4e50-90c6-54efe21c4631 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:19.952861 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-d6586a8e-2211-4e50-90c6-54efe21c4631 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:20.358377 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-d6586a8e-2211-4e50-90c6-54efe21c4631 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:20.417160 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d6586a8e-2211-4e50-90c6-54efe21c4631 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1214 microversion: 2.1 time: 0.471900 Jun 22 08:58:20.426678 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 7/14] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:19 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1214 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:20.636769 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-50bb9db0-00d4-4464-a649-2816751e0df0 tempest-VolumesTestJSON-685582747 tempest-VolumesTestJSON-685582747-project] Calling method '.version_select at 0x7f5757798790>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:20.739130 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-828f50e1-cb6b-406b-81f4-c58cd26f2331 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Flavor limits 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 08:58:20.739757 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-828f50e1-cb6b-406b-81f4-c58cd26f2331 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Image limits 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 08:58:20.740314 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-828f50e1-cb6b-406b-81f4-c58cd26f2331 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Flavor pref 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 08:58:20.741058 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-828f50e1-cb6b-406b-81f4-c58cd26f2331 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Image pref 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 08:58:20.741721 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-828f50e1-cb6b-406b-81f4-c58cd26f2331 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 08:58:20.789485 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-828f50e1-cb6b-406b-81f4-c58cd26f2331 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:20.791003 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-828f50e1-cb6b-406b-81f4-c58cd26f2331 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:20.799356 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-828f50e1-cb6b-406b-81f4-c58cd26f2331 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:20.801062 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-828f50e1-cb6b-406b-81f4-c58cd26f2331 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:20.862230 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.quota [None req-828f50e1-cb6b-406b-81f4-c58cd26f2331 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Getting quotas for project 4019eed8f0a140f099ca1c123ff71cef. Resources: {'cores', 'instances', 'ram'} {{(pid=118024) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 08:58:20.875348 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.quota [None req-828f50e1-cb6b-406b-81f4-c58cd26f2331 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Getting quotas for user 1a8d3cd247d743cf8c93ee15d8574602 and project 4019eed8f0a140f099ca1c123ff71cef. Resources: {'cores', 'instances', 'ram'} {{(pid=118024) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 08:58:20.900520 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-828f50e1-cb6b-406b-81f4-c58cd26f2331 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Going to run 1 instances... {{(pid=118024) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 08:58:20.910185 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-828f50e1-cb6b-406b-81f4-c58cd26f2331 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c24d36a8-7909-4174-9b12-42c8d76647ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118024) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 08:58:20.982191 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-50bb9db0-00d4-4464-a649-2816751e0df0 tempest-VolumesTestJSON-685582747 tempest-VolumesTestJSON-685582747-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ede9ab24-ccfb-4430-925d-88a77aa7b8d6" status: 200 len: 351 microversion: 2.1 time: 0.341208 Jun 22 08:58:20.982191 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 8/15] 10.222.0.16 () {58 vars in 1244 bytes} [Wed Jun 22 08:58:20 2022] GET /compute/v2.1/os-volumes/ede9ab24-ccfb-4430-925d-88a77aa7b8d6 => generated 351 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 08:58:21.087394 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-828f50e1-cb6b-406b-81f4-c58cd26f2331 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.145433 Jun 22 08:58:21.090580 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 8/16] 10.222.0.16 () {60 vars in 1146 bytes} [Wed Jun 22 08:58:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 3152 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 08:58:21.114542 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1a7af4ea-fa48-4699-80ba-bdc615751016 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:21.117803 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1a7af4ea-fa48-4699-80ba-bdc615751016 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:21.344148 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-1a7af4ea-fa48-4699-80ba-bdc615751016 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:21.359457 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1a7af4ea-fa48-4699-80ba-bdc615751016 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1222 microversion: 2.1 time: 0.262903 Jun 22 08:58:21.360053 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 9/17] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:21 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1222 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:21.437330 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ecdd8915-528f-443d-9f2f-88621feaa6db tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:21.438235 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ecdd8915-528f-443d-9f2f-88621feaa6db tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:21.546803 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-684448e0-2a45-4e21-8fc9-eafa6803a38f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Action: 'create', calling method: .version_select at 0x7f5757737940>, body: {"keypair": {"name": "tempest-keypair-489945139", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHjakNs75erVNxKZ/i1MtpMj8dBiSGLHIyIY4JsIpPblR8XsNdliOixobfo3wSk4gSsRR+ND8WWeMyVl9EI/X6qEeKG1DgkcK3Vghncewnu7wLtk6sw6/yV05J/qbRJ0w=="}} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:58:21.577402 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.quota [None req-684448e0-2a45-4e21-8fc9-eafa6803a38f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Getting quotas for project b172c496b3304444bd6169a09cff85d2. Resources: {'key_pairs'} {{(pid=118025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 08:58:21.597055 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.quota [None req-684448e0-2a45-4e21-8fc9-eafa6803a38f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Getting quotas for user dc534f42584b4e57a4706c81729cacd5 and project b172c496b3304444bd6169a09cff85d2. Resources: {'key_pairs'} {{(pid=118025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 08:58:21.666797 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ecdd8915-528f-443d-9f2f-88621feaa6db tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:21.675577 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ecdd8915-528f-443d-9f2f-88621feaa6db tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1214 microversion: 2.1 time: 0.243808 Jun 22 08:58:21.681274 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 10/18] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:21 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1214 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:21.813202 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-684448e0-2a45-4e21-8fc9-eafa6803a38f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.836212 Jun 22 08:58:21.814315 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 9/19] 10.222.0.16 () {62 vars in 1199 bytes} [Wed Jun 22 08:58:20 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 838 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 22 08:58:22.276652 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-2b171f87-4293-4b40-8756-def834c9fcb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1535102750", "imageRef": "c24d36a8-7909-4174-9b12-42c8d76647ac", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a75772f1-9e0a-482d-85cb-39939e4ffc1e"}], "security_groups": [{"name": "tempest-securitygroup--1001833176"}], "key_name": "tempest-keypair-1306165953", "user_data": "}} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:58:22.380517 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f1f4fc60-1d71-4354-8cb7-1af6314ec69c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:22.381194 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-f1f4fc60-1d71-4354-8cb7-1af6314ec69c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:22.577856 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-f1f4fc60-1d71-4354-8cb7-1af6314ec69c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:22.596392 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f1f4fc60-1d71-4354-8cb7-1af6314ec69c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1222 microversion: 2.1 time: 0.222500 Jun 22 08:58:22.598369 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 10/20] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:22 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1222 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:22.648518 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.network.neutron [None req-2b171f87-4293-4b40-8756-def834c9fcb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] validate_networks() for [('a75772f1-9e0a-482d-85cb-39939e4ffc1e', None, None, None, None, None)] {{(pid=118024) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 08:58:22.706741 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-1044d541-93e8-4007-b3df-ae99ea868a21 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:22.708473 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-1044d541-93e8-4007-b3df-ae99ea868a21 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:22.738251 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1044d541-93e8-4007-b3df-ae99ea868a21 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:22.738970 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1044d541-93e8-4007-b3df-ae99ea868a21 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:22.742299 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1044d541-93e8-4007-b3df-ae99ea868a21 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:22.744821 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1044d541-93e8-4007-b3df-ae99ea868a21 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:23.273289 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-1044d541-93e8-4007-b3df-ae99ea868a21 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:23.286450 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-1044d541-93e8-4007-b3df-ae99ea868a21 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1210 microversion: 2.1 time: 0.590517 Jun 22 08:58:23.303645 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 11/21] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:22 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1210 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:23.614769 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f5b198a2-25f3-4f80-88fe-5975ad7432c0 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:23.616923 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-f5b198a2-25f3-4f80-88fe-5975ad7432c0 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:23.643187 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f5b198a2-25f3-4f80-88fe-5975ad7432c0 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:23.662185 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f5b198a2-25f3-4f80-88fe-5975ad7432c0 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:23.675345 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f5b198a2-25f3-4f80-88fe-5975ad7432c0 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:23.678584 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f5b198a2-25f3-4f80-88fe-5975ad7432c0 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:23.976536 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-2b171f87-4293-4b40-8756-def834c9fcb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Flavor limits 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 08:58:23.977653 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-2b171f87-4293-4b40-8756-def834c9fcb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Image limits 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 08:58:23.978502 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-2b171f87-4293-4b40-8756-def834c9fcb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Flavor pref 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 08:58:23.979116 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-2b171f87-4293-4b40-8756-def834c9fcb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Image pref 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 08:58:23.979734 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-2b171f87-4293-4b40-8756-def834c9fcb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 08:58:24.002614 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2b171f87-4293-4b40-8756-def834c9fcb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:24.007482 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2b171f87-4293-4b40-8756-def834c9fcb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:24.009879 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2b171f87-4293-4b40-8756-def834c9fcb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:24.012657 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2b171f87-4293-4b40-8756-def834c9fcb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:24.056860 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.quota [None req-2b171f87-4293-4b40-8756-def834c9fcb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Getting quotas for project 175a336dc3fd44c2ae20e51b46d423e4. Resources: {'cores', 'instances', 'ram'} {{(pid=118024) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 08:58:24.076455 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.quota [None req-2b171f87-4293-4b40-8756-def834c9fcb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Getting quotas for user 566b001b7a504fadb85ad04ea1be22f2 and project 175a336dc3fd44c2ae20e51b46d423e4. Resources: {'cores', 'instances', 'ram'} {{(pid=118024) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 08:58:24.081167 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-f5b198a2-25f3-4f80-88fe-5975ad7432c0 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:24.093575 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f5b198a2-25f3-4f80-88fe-5975ad7432c0 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1226 microversion: 2.1 time: 0.483231 Jun 22 08:58:24.093887 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-2b171f87-4293-4b40-8756-def834c9fcb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Going to run 1 instances... {{(pid=118024) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 08:58:24.105064 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 12/22] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:23 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1226 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:24.111866 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-2b171f87-4293-4b40-8756-def834c9fcb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c24d36a8-7909-4174-9b12-42c8d76647ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118024) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 08:58:24.305493 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2c024022-1536-4e0c-874f-653d59e5dc4c tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:24.306221 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2c024022-1536-4e0c-874f-653d59e5dc4c tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:24.321618 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2c024022-1536-4e0c-874f-653d59e5dc4c tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:24.324763 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2c024022-1536-4e0c-874f-653d59e5dc4c tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:24.326736 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2c024022-1536-4e0c-874f-653d59e5dc4c tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:24.328445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2c024022-1536-4e0c-874f-653d59e5dc4c tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:24.379882 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-2b171f87-4293-4b40-8756-def834c9fcb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.107919 Jun 22 08:58:24.391469 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 11/23] 10.222.0.16 () {60 vars in 1146 bytes} [Wed Jun 22 08:58:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 2120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 08:58:24.401828 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-5db87500-48f5-42de-90ca-3d6167725ce1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:24.407281 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-5db87500-48f5-42de-90ca-3d6167725ce1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:24.785417 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-5db87500-48f5-42de-90ca-3d6167725ce1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:24.786680 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-2c024022-1536-4e0c-874f-653d59e5dc4c tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:24.798924 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-5db87500-48f5-42de-90ca-3d6167725ce1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1238 microversion: 2.1 time: 0.406200 Jun 22 08:58:24.803555 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 12/24] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:24 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1238 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:24.813839 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2c024022-1536-4e0c-874f-653d59e5dc4c tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1284 microversion: 2.1 time: 0.506003 Jun 22 08:58:24.816221 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 13/25] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:24 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1284 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:24.885088 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-777412e6-3fbf-43f6-976c-b94c960d0ab5 tempest-VolumesTestJSON-685582747 tempest-VolumesTestJSON-685582747-project] Calling method '.version_select at 0x7f57566ece50>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:24.965279 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-777412e6-3fbf-43f6-976c-b94c960d0ab5 tempest-VolumesTestJSON-685582747 tempest-VolumesTestJSON-685582747-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/bd1b2bb4-6e27-46c5-83ce-030c1dc23bb7" status: 200 len: 350 microversion: 2.1 time: 0.086659 Jun 22 08:58:24.972977 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 14/26] 10.222.0.16 () {58 vars in 1244 bytes} [Wed Jun 22 08:58:24 2022] GET /compute/v2.1/os-volumes/bd1b2bb4-6e27-46c5-83ce-030c1dc23bb7 => generated 350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:58:24.985340 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-485dc580-2a95-4be3-8865-003b107539cd tempest-VolumesTestJSON-685582747 tempest-VolumesTestJSON-685582747-project] Calling method '.version_select at 0x7f5756eac3a0>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:25.113039 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-5da9113b-2926-4dd7-b130-9fe2c00d5619 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:25.113744 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-5da9113b-2926-4dd7-b130-9fe2c00d5619 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:25.129829 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5da9113b-2926-4dd7-b130-9fe2c00d5619 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:25.137381 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5da9113b-2926-4dd7-b130-9fe2c00d5619 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:25.144728 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5da9113b-2926-4dd7-b130-9fe2c00d5619 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:25.145457 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5da9113b-2926-4dd7-b130-9fe2c00d5619 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:25.219903 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-485dc580-2a95-4be3-8865-003b107539cd tempest-VolumesTestJSON-685582747 tempest-VolumesTestJSON-685582747-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.245815 Jun 22 08:58:25.221311 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 13/27] 10.222.0.16 () {58 vars in 1133 bytes} [Wed Jun 22 08:58:24 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:58:25.234983 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-dac2ebba-8fa8-4824-986d-7b261dd017ec tempest-VolumesTestJSON-685582747 tempest-VolumesTestJSON-685582747-project] Calling method '.version_select at 0x7f5756ebb820>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:25.443569 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-dac2ebba-8fa8-4824-986d-7b261dd017ec tempest-VolumesTestJSON-685582747 tempest-VolumesTestJSON-685582747-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.213423 Jun 22 08:58:25.445540 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 14/28] 10.222.0.16 () {58 vars in 1148 bytes} [Wed Jun 22 08:58:25 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:58:25.471817 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-88306dac-2f49-424b-8383-886562c53f1f tempest-VolumesTestJSON-685582747 tempest-VolumesTestJSON-685582747-project] Calling method '.version_select at 0x7f5756ec39d0>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:25.776798 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-88306dac-2f49-424b-8383-886562c53f1f tempest-VolumesTestJSON-685582747 tempest-VolumesTestJSON-685582747-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.321175 Jun 22 08:58:25.778833 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 15/29] 10.222.0.16 () {58 vars in 1133 bytes} [Wed Jun 22 08:58:25 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:58:25.794121 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-2876bb86-ec93-4266-9d5e-9da8a3995b93 tempest-VolumesTestJSON-685582747 tempest-VolumesTestJSON-685582747-project] Calling method '.version_select at 0x7f5756ec30d0>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:25.881172 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-5da9113b-2926-4dd7-b130-9fe2c00d5619 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:25.895125 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-5da9113b-2926-4dd7-b130-9fe2c00d5619 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1274 microversion: 2.1 time: 0.785654 Jun 22 08:58:25.898846 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 15/30] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:25 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1274 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:58:25.914616 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-cf86a015-9008-4ccd-8231-2fca2502a0ad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:25.918209 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-cf86a015-9008-4ccd-8231-2fca2502a0ad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:26.207182 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-2876bb86-ec93-4266-9d5e-9da8a3995b93 tempest-VolumesTestJSON-685582747 tempest-VolumesTestJSON-685582747-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.419068 Jun 22 08:58:26.212483 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 16/31] 10.222.0.16 () {58 vars in 1166 bytes} [Wed Jun 22 08:58:25 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 08:58:26.221697 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-bdaffe16-a9be-4be5-a646-744472651e02 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:26.223687 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-bdaffe16-a9be-4be5-a646-744472651e02 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:26.240720 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bdaffe16-a9be-4be5-a646-744472651e02 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:26.241182 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bdaffe16-a9be-4be5-a646-744472651e02 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:26.244726 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bdaffe16-a9be-4be5-a646-744472651e02 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:26.246876 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bdaffe16-a9be-4be5-a646-744472651e02 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:26.326628 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-cf86a015-9008-4ccd-8231-2fca2502a0ad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:26.338772 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-cf86a015-9008-4ccd-8231-2fca2502a0ad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1238 microversion: 2.1 time: 0.437561 Jun 22 08:58:26.344680 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 16/32] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:25 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1238 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:26.362014 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-8a674eb9-0b1c-4aab-bd99-46b3a9781523 tempest-VolumesTestJSON-685582747 tempest-VolumesTestJSON-685582747-project] Calling method '.version_select at 0x7f575662ff70>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:26.637494 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-8a674eb9-0b1c-4aab-bd99-46b3a9781523 tempest-VolumesTestJSON-685582747 tempest-VolumesTestJSON-685582747-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.291057 Jun 22 08:58:26.638157 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 17/33] 10.222.0.16 () {58 vars in 1169 bytes} [Wed Jun 22 08:58:26 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:58:26.650816 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9705d258-42dc-478c-aeb3-bf4a46a3be18 tempest-VolumesTestJSON-685582747 tempest-VolumesTestJSON-685582747-project] Calling method '.version_select at 0x7f5756642ca0>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:26.789957 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9705d258-42dc-478c-aeb3-bf4a46a3be18 tempest-VolumesTestJSON-685582747 tempest-VolumesTestJSON-685582747-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.142853 Jun 22 08:58:26.790542 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 18/34] 10.222.0.16 () {58 vars in 1154 bytes} [Wed Jun 22 08:58:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:26.803314 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9c74ed4c-1092-4a37-ba5c-02d452cb6131 tempest-VolumesTestJSON-685582747 tempest-VolumesTestJSON-685582747-project] Calling method '.version_select at 0x7f5756642f70>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:26.807140 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-bdaffe16-a9be-4be5-a646-744472651e02 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:26.841330 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-bdaffe16-a9be-4be5-a646-744472651e02 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1272 microversion: 2.1 time: 0.624114 Jun 22 08:58:26.856155 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 17/35] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:26 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1272 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:26.915090 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-e2c22252-bb0b-4781-8bf0-0bc4ce7278c2 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:26.915294 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-e2c22252-bb0b-4781-8bf0-0bc4ce7278c2 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:26.932568 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e2c22252-bb0b-4781-8bf0-0bc4ce7278c2 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:26.937459 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e2c22252-bb0b-4781-8bf0-0bc4ce7278c2 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:26.949217 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9c74ed4c-1092-4a37-ba5c-02d452cb6131 tempest-VolumesTestJSON-685582747 tempest-VolumesTestJSON-685582747-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.149910 Jun 22 08:58:26.950212 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e2c22252-bb0b-4781-8bf0-0bc4ce7278c2 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:26.957496 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e2c22252-bb0b-4781-8bf0-0bc4ce7278c2 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:26.969902 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 19/36] 10.222.0.16 () {58 vars in 1187 bytes} [Wed Jun 22 08:58:26 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 08:58:26.969902 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-34f960bf-b1d0-43fc-b3df-30ab6ef85590 tempest-VolumesTestJSON-685582747 tempest-VolumesTestJSON-685582747-project] Calling method '.version_select at 0x7f5756682280>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:27.157912 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-34f960bf-b1d0-43fc-b3df-30ab6ef85590 tempest-VolumesTestJSON-685582747 tempest-VolumesTestJSON-685582747-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.197237 Jun 22 08:58:27.158855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 20/37] 10.222.0.16 () {58 vars in 1154 bytes} [Wed Jun 22 08:58:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:27.341458 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-e2c22252-bb0b-4781-8bf0-0bc4ce7278c2 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:27.341458 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-e2c22252-bb0b-4781-8bf0-0bc4ce7278c2 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1280 microversion: 2.1 time: 0.425461 Jun 22 08:58:27.341458 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 18/38] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:26 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1280 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:58:27.363689 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7a19c01a-bf14-4704-abd3-37264c4481c5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:27.364550 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7a19c01a-bf14-4704-abd3-37264c4481c5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:27.386746 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7a19c01a-bf14-4704-abd3-37264c4481c5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:27.388620 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7a19c01a-bf14-4704-abd3-37264c4481c5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:27.392914 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7a19c01a-bf14-4704-abd3-37264c4481c5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:27.394774 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7a19c01a-bf14-4704-abd3-37264c4481c5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:27.759938 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7a19c01a-bf14-4704-abd3-37264c4481c5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:27.773575 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7a19c01a-bf14-4704-abd3-37264c4481c5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1242 microversion: 2.1 time: 0.414950 Jun 22 08:58:27.774194 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 21/39] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:27 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1242 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:27.866886 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c200e385-49b7-4b8c-bcd8-3935fb8efbbe tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:27.867808 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c200e385-49b7-4b8c-bcd8-3935fb8efbbe tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:27.885373 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c200e385-49b7-4b8c-bcd8-3935fb8efbbe tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:27.891057 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c200e385-49b7-4b8c-bcd8-3935fb8efbbe tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:27.892443 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c200e385-49b7-4b8c-bcd8-3935fb8efbbe tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:27.893118 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c200e385-49b7-4b8c-bcd8-3935fb8efbbe tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:28.356354 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-89ca2bd3-8030-4681-9692-e289aff626d9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:28.359574 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-89ca2bd3-8030-4681-9692-e289aff626d9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:28.375565 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-89ca2bd3-8030-4681-9692-e289aff626d9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:28.376381 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-89ca2bd3-8030-4681-9692-e289aff626d9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:28.380547 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-89ca2bd3-8030-4681-9692-e289aff626d9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:28.381855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-89ca2bd3-8030-4681-9692-e289aff626d9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:28.743537 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell0:SELECT=2 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:58:28.815571 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-89ca2bd3-8030-4681-9692-e289aff626d9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:28.843300 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-89ca2bd3-8030-4681-9692-e289aff626d9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1280 microversion: 2.1 time: 0.487600 Jun 22 08:58:28.845303 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 22/40] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:28 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1280 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:28.866902 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-025aa715-28aa-495d-ba66-e5c3e7b0d6b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:28.869537 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-025aa715-28aa-495d-ba66-e5c3e7b0d6b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:28.898656 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-025aa715-28aa-495d-ba66-e5c3e7b0d6b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:28.899124 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-025aa715-28aa-495d-ba66-e5c3e7b0d6b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:28.899916 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-025aa715-28aa-495d-ba66-e5c3e7b0d6b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:28.900360 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-025aa715-28aa-495d-ba66-e5c3e7b0d6b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:29.251268 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-025aa715-28aa-495d-ba66-e5c3e7b0d6b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:29.289635 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-025aa715-28aa-495d-ba66-e5c3e7b0d6b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1290 microversion: 2.1 time: 0.409147 Jun 22 08:58:29.289635 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 23/41] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:28 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1290 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:29.733033 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-c200e385-49b7-4b8c-bcd8-3935fb8efbbe tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:29.748732 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c200e385-49b7-4b8c-bcd8-3935fb8efbbe tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1314 microversion: 2.1 time: 1.886355 Jun 22 08:58:29.760155 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 19/42] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:27 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1314 bytes in 1894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:29.863368 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c6b71bd1-18cd-4f79-91c2-ca84a532fabf tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:29.864195 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c6b71bd1-18cd-4f79-91c2-ca84a532fabf tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:29.879555 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c6b71bd1-18cd-4f79-91c2-ca84a532fabf tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:29.880678 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c6b71bd1-18cd-4f79-91c2-ca84a532fabf tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:29.882990 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c6b71bd1-18cd-4f79-91c2-ca84a532fabf tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:29.887033 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c6b71bd1-18cd-4f79-91c2-ca84a532fabf tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:30.056118 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c6b71bd1-18cd-4f79-91c2-ca84a532fabf tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:30.069265 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c6b71bd1-18cd-4f79-91c2-ca84a532fabf tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1280 microversion: 2.1 time: 0.208897 Jun 22 08:58:30.071487 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 24/43] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:29 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1280 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:30.301400 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-61033b13-df8f-4b46-86d2-e8d274a10652 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-882110393", "imageRef": "c24d36a8-7909-4174-9b12-42c8d76647ac", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "32fd7d44-45b4-465a-a792-69017447bde6"}], "security_groups": [{"name": "tempest-securitygroup--817546382"}], "key_name": "tempest-keypair-1053939892", "user_data": "}} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:58:30.307836 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2009cd11-349c-4507-a8be-f3f0636b627f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:30.308527 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2009cd11-349c-4507-a8be-f3f0636b627f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:30.351925 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2009cd11-349c-4507-a8be-f3f0636b627f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:30.352407 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2009cd11-349c-4507-a8be-f3f0636b627f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:30.353269 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2009cd11-349c-4507-a8be-f3f0636b627f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:30.353727 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2009cd11-349c-4507-a8be-f3f0636b627f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:30.631767 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-2009cd11-349c-4507-a8be-f3f0636b627f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:30.661925 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2009cd11-349c-4507-a8be-f3f0636b627f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1296 microversion: 2.1 time: 0.368321 Jun 22 08:58:30.663286 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 25/44] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:30 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1296 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:58:30.771830 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-8e4d0f36-6349-4b32-b5e0-61b1400da9b7 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:30.772660 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-8e4d0f36-6349-4b32-b5e0-61b1400da9b7 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:30.790837 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.network.neutron [None req-61033b13-df8f-4b46-86d2-e8d274a10652 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] validate_networks() for [('32fd7d44-45b4-465a-a792-69017447bde6', None, None, None, None, None)] {{(pid=118024) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 08:58:30.800447 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8e4d0f36-6349-4b32-b5e0-61b1400da9b7 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:30.813571 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8e4d0f36-6349-4b32-b5e0-61b1400da9b7 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:30.817994 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8e4d0f36-6349-4b32-b5e0-61b1400da9b7 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:30.822135 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8e4d0f36-6349-4b32-b5e0-61b1400da9b7 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:31.739643 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-8e4d0f36-6349-4b32-b5e0-61b1400da9b7 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:31.750232 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-8e4d0f36-6349-4b32-b5e0-61b1400da9b7 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1314 microversion: 2.1 time: 0.985708 Jun 22 08:58:31.755534 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 26/45] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:30 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1314 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:31.760668 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a783dd36-5088-4d9b-a8cb-faaa64df75c1 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:31.764742 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-a783dd36-5088-4d9b-a8cb-faaa64df75c1 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:31.789576 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a783dd36-5088-4d9b-a8cb-faaa64df75c1 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:31.792383 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a783dd36-5088-4d9b-a8cb-faaa64df75c1 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:31.793476 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a783dd36-5088-4d9b-a8cb-faaa64df75c1 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:31.796441 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a783dd36-5088-4d9b-a8cb-faaa64df75c1 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:32.358431 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-a783dd36-5088-4d9b-a8cb-faaa64df75c1 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:32.378643 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a783dd36-5088-4d9b-a8cb-faaa64df75c1 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.621602 Jun 22 08:58:32.385318 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 27/46] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:31 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:32.425200 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-71d0c045-884e-4b56-bed5-7b11e82779f8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:32.425200 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-71d0c045-884e-4b56-bed5-7b11e82779f8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:32.437195 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-71d0c045-884e-4b56-bed5-7b11e82779f8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:32.437769 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-71d0c045-884e-4b56-bed5-7b11e82779f8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:32.438831 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-71d0c045-884e-4b56-bed5-7b11e82779f8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:32.439401 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-71d0c045-884e-4b56-bed5-7b11e82779f8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:32.699356 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-61033b13-df8f-4b46-86d2-e8d274a10652 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Flavor limits 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 08:58:32.700132 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-61033b13-df8f-4b46-86d2-e8d274a10652 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Image limits 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 08:58:32.701338 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-61033b13-df8f-4b46-86d2-e8d274a10652 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Flavor pref 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 08:58:32.702036 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-61033b13-df8f-4b46-86d2-e8d274a10652 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Image pref 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 08:58:32.702478 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-61033b13-df8f-4b46-86d2-e8d274a10652 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 08:58:32.710207 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-71d0c045-884e-4b56-bed5-7b11e82779f8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:32.719868 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-71d0c045-884e-4b56-bed5-7b11e82779f8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1296 microversion: 2.1 time: 0.333168 Jun 22 08:58:32.722743 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 28/47] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:32 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1296 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:32.740070 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-61033b13-df8f-4b46-86d2-e8d274a10652 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:32.743992 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-61033b13-df8f-4b46-86d2-e8d274a10652 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:32.753174 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-61033b13-df8f-4b46-86d2-e8d274a10652 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:32.753960 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-61033b13-df8f-4b46-86d2-e8d274a10652 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:32.771963 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7739f220-c5e4-4b1b-861c-89061635f01a tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:32.773445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7739f220-c5e4-4b1b-861c-89061635f01a tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:32.791814 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7739f220-c5e4-4b1b-861c-89061635f01a tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:32.793937 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7739f220-c5e4-4b1b-861c-89061635f01a tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:32.799665 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7739f220-c5e4-4b1b-861c-89061635f01a tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:32.801078 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7739f220-c5e4-4b1b-861c-89061635f01a tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:32.831230 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.quota [None req-61033b13-df8f-4b46-86d2-e8d274a10652 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Getting quotas for project 9ebdcb9809a84f25bd578f8aca09802c. Resources: {'cores', 'instances', 'ram'} {{(pid=118024) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 08:58:32.841680 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.quota [None req-61033b13-df8f-4b46-86d2-e8d274a10652 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Getting quotas for user 71ea2610ccc044de9d66444b4038fe9e and project 9ebdcb9809a84f25bd578f8aca09802c. Resources: {'cores', 'instances', 'ram'} {{(pid=118024) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 08:58:32.893615 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-61033b13-df8f-4b46-86d2-e8d274a10652 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Going to run 1 instances... {{(pid=118024) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 08:58:32.900881 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-61033b13-df8f-4b46-86d2-e8d274a10652 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c24d36a8-7909-4174-9b12-42c8d76647ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118024) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 08:58:33.196201 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-61033b13-df8f-4b46-86d2-e8d274a10652 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.891165 Jun 22 08:58:33.196201 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 20/48] 10.222.0.16 () {60 vars in 1146 bytes} [Wed Jun 22 08:58:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 2893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 08:58:33.206316 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3e57ecf8-31ca-4b3d-aafb-0a68a9519fac tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:33.206944 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3e57ecf8-31ca-4b3d-aafb-0a68a9519fac tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:33.554752 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3e57ecf8-31ca-4b3d-aafb-0a68a9519fac tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:33.564303 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3e57ecf8-31ca-4b3d-aafb-0a68a9519fac tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1241 microversion: 2.1 time: 0.365650 Jun 22 08:58:33.569064 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 21/49] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:33 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1241 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:33.612739 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-446a13e2-f2de-49b1-9c08-a3c4794a964b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:33.622313 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-446a13e2-f2de-49b1-9c08-a3c4794a964b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:33.636118 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7739f220-c5e4-4b1b-861c-89061635f01a tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:33.647534 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7739f220-c5e4-4b1b-861c-89061635f01a tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1314 microversion: 2.1 time: 0.879494 Jun 22 08:58:33.658142 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 29/50] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:32 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1314 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:58:33.664485 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-3669afe5-b730-4c1b-996f-53e5f840fe58 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1423751563", "imageRef": "c24d36a8-7909-4174-9b12-42c8d76647ac", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "719442ce-3257-4f9d-93de-f6be967fc95d"}], "security_groups": [{"name": "tempest-securitygroup--1087072809"}], "key_name": "tempest-keypair-489945139", "user_data": "}} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:58:33.672369 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-446a13e2-f2de-49b1-9c08-a3c4794a964b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:33.673278 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-446a13e2-f2de-49b1-9c08-a3c4794a964b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:33.679039 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-446a13e2-f2de-49b1-9c08-a3c4794a964b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:33.679721 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-446a13e2-f2de-49b1-9c08-a3c4794a964b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:34.151993 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.network.neutron [None req-3669afe5-b730-4c1b-996f-53e5f840fe58 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] validate_networks() for [('719442ce-3257-4f9d-93de-f6be967fc95d', None, None, None, None, None)] {{(pid=118025) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 08:58:34.539502 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-446a13e2-f2de-49b1-9c08-a3c4794a964b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:34.568315 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-446a13e2-f2de-49b1-9c08-a3c4794a964b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.990910 Jun 22 08:58:34.575284 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 22/51] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:33 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:34.604419 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-4669a2c8-8036-4d69-96e3-0f9c8fd7f9da tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:34.611752 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-4669a2c8-8036-4d69-96e3-0f9c8fd7f9da tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:34.637872 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4669a2c8-8036-4d69-96e3-0f9c8fd7f9da tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:34.640184 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4669a2c8-8036-4d69-96e3-0f9c8fd7f9da tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:34.641072 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4669a2c8-8036-4d69-96e3-0f9c8fd7f9da tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:34.644073 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4669a2c8-8036-4d69-96e3-0f9c8fd7f9da tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:34.937574 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-4669a2c8-8036-4d69-96e3-0f9c8fd7f9da tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:34.966753 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-4669a2c8-8036-4d69-96e3-0f9c8fd7f9da tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1296 microversion: 2.1 time: 0.368603 Jun 22 08:58:34.969093 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 23/52] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:34 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1296 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:34.983533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-0c0dec86-4c31-4b23-b09f-533a212a6e7b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:34.984168 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-0c0dec86-4c31-4b23-b09f-533a212a6e7b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:35.004359 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:58:35.171026 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:58:35.469788 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-0c0dec86-4c31-4b23-b09f-533a212a6e7b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:35.504952 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-0c0dec86-4c31-4b23-b09f-533a212a6e7b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1241 microversion: 2.1 time: 0.534399 Jun 22 08:58:35.507181 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 24/53] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:34 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1241 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:35.541201 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-253a1d2e-fd3d-49d7-882a-0f43d01aa5bf tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:35.544939 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-253a1d2e-fd3d-49d7-882a-0f43d01aa5bf tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:35.596700 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-253a1d2e-fd3d-49d7-882a-0f43d01aa5bf tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:35.597188 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-253a1d2e-fd3d-49d7-882a-0f43d01aa5bf tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:35.597979 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-253a1d2e-fd3d-49d7-882a-0f43d01aa5bf tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:35.598460 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-253a1d2e-fd3d-49d7-882a-0f43d01aa5bf tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:36.330236 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell0:SELECT=24 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:58:36.915055 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-253a1d2e-fd3d-49d7-882a-0f43d01aa5bf tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:36.936668 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-253a1d2e-fd3d-49d7-882a-0f43d01aa5bf tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1314 microversion: 2.1 time: 1.427474 Jun 22 08:58:36.937524 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 25/54] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:35 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1314 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:37.000238 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-3669afe5-b730-4c1b-996f-53e5f840fe58 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Flavor limits 0:0:0 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 08:58:37.001389 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-3669afe5-b730-4c1b-996f-53e5f840fe58 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Image limits 0:0:0 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 08:58:37.002099 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-3669afe5-b730-4c1b-996f-53e5f840fe58 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Flavor pref 0:0:0 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 08:58:37.002942 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-3669afe5-b730-4c1b-996f-53e5f840fe58 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Image pref 0:0:0 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 08:58:37.004188 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-3669afe5-b730-4c1b-996f-53e5f840fe58 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 08:58:37.026844 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3669afe5-b730-4c1b-996f-53e5f840fe58 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:37.027792 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3669afe5-b730-4c1b-996f-53e5f840fe58 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:37.031171 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3669afe5-b730-4c1b-996f-53e5f840fe58 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:37.032762 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3669afe5-b730-4c1b-996f-53e5f840fe58 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:37.133915 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.quota [None req-3669afe5-b730-4c1b-996f-53e5f840fe58 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Getting quotas for project b172c496b3304444bd6169a09cff85d2. Resources: {'cores', 'instances', 'ram'} {{(pid=118025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 08:58:37.150281 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.quota [None req-3669afe5-b730-4c1b-996f-53e5f840fe58 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Getting quotas for user dc534f42584b4e57a4706c81729cacd5 and project b172c496b3304444bd6169a09cff85d2. Resources: {'cores', 'instances', 'ram'} {{(pid=118025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 08:58:37.177834 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-3669afe5-b730-4c1b-996f-53e5f840fe58 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Going to run 1 instances... {{(pid=118025) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 08:58:37.180515 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-3669afe5-b730-4c1b-996f-53e5f840fe58 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c24d36a8-7909-4174-9b12-42c8d76647ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 08:58:37.298694 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [req-7eff7081-02d0-43c9-b7f0-67559d0f7b77 req-c0f18409-ca6d-4b70-b466-c0c999c3bb02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "713f284f-527e-4246-a442-f2d8a32428d5", "tag": "a3826696-5f1e-4efc-8516-fc2d14d29e17"}]} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:58:37.321174 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-7eff7081-02d0-43c9-b7f0-67559d0f7b77 req-c0f18409-ca6d-4b70-b466-c0c999c3bb02 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:37.321635 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-7eff7081-02d0-43c9-b7f0-67559d0f7b77 req-c0f18409-ca6d-4b70-b466-c0c999c3bb02 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:37.368709 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-3669afe5-b730-4c1b-996f-53e5f840fe58 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.707378 Jun 22 08:58:37.370854 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 30/55] 10.222.0.16 () {62 vars in 1187 bytes} [Wed Jun 22 08:58:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 3712 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 22 08:58:37.390987 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-feb92794-b4db-4c36-a14f-fb486bef9bfd tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:37.391871 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-feb92794-b4db-4c36-a14f-fb486bef9bfd tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:37.401314 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.compute.server_external_events [req-7eff7081-02d0-43c9-b7f0-67559d0f7b77 req-c0f18409-ca6d-4b70-b466-c0c999c3bb02 service nova] Creating event network-changed:a3826696-5f1e-4efc-8516-fc2d14d29e17 for instance 713f284f-527e-4246-a442-f2d8a32428d5 on hv-cinder-84599 Jun 22 08:58:37.422673 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-7eff7081-02d0-43c9-b7f0-67559d0f7b77 req-c0f18409-ca6d-4b70-b466-c0c999c3bb02 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118024) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 22 08:58:37.432044 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-879031f7-73da-4582-94cf-23c4a2755551 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:37.435500 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-879031f7-73da-4582-94cf-23c4a2755551 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:37.453943 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-feb92794-b4db-4c36-a14f-fb486bef9bfd tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:37.455622 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-879031f7-73da-4582-94cf-23c4a2755551 None None] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:37.456451 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-feb92794-b4db-4c36-a14f-fb486bef9bfd tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:37.457517 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-feb92794-b4db-4c36-a14f-fb486bef9bfd tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:37.461916 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-879031f7-73da-4582-94cf-23c4a2755551 None None] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:37.465241 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-feb92794-b4db-4c36-a14f-fb486bef9bfd tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:37.511981 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.compute.rpcapi [None req-879031f7-73da-4582-94cf-23c4a2755551 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 22 08:58:37.518301 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-879031f7-73da-4582-94cf-23c4a2755551 None None] Releasing lock "compute-rpcapi-router" {{(pid=118024) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 22 08:58:37.574949 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-879031f7-73da-4582-94cf-23c4a2755551 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.635204 Jun 22 08:58:37.575919 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 26/56] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 08:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:58:37.582125 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-501c0647-0b0e-4b01-b475-33d45551368a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:37.583006 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-501c0647-0b0e-4b01-b475-33d45551368a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:37.606267 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-501c0647-0b0e-4b01-b475-33d45551368a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:37.607271 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-501c0647-0b0e-4b01-b475-33d45551368a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:37.608059 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-501c0647-0b0e-4b01-b475-33d45551368a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:37.611800 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-501c0647-0b0e-4b01-b475-33d45551368a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:38.229283 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-501c0647-0b0e-4b01-b475-33d45551368a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:38.237677 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-501c0647-0b0e-4b01-b475-33d45551368a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.660491 Jun 22 08:58:38.238269 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 27/57] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:37 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:38.250853 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6d92238c-cc09-4774-8529-840f50e9cd37 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:38.251483 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-6d92238c-cc09-4774-8529-840f50e9cd37 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:38.253350 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-feb92794-b4db-4c36-a14f-fb486bef9bfd tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:38.257813 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6d92238c-cc09-4774-8529-840f50e9cd37 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:38.258273 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6d92238c-cc09-4774-8529-840f50e9cd37 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:38.259093 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6d92238c-cc09-4774-8529-840f50e9cd37 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:38.259631 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6d92238c-cc09-4774-8529-840f50e9cd37 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:38.260766 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-feb92794-b4db-4c36-a14f-fb486bef9bfd tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.888695 Jun 22 08:58:38.261406 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 31/58] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:37 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:38.266427 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-ff1e7a18-69f9-442b-a045-9e87af930566 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:38.267059 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-ff1e7a18-69f9-442b-a045-9e87af930566 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:38.331021 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-ff1e7a18-69f9-442b-a045-9e87af930566 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:38.338565 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-ff1e7a18-69f9-442b-a045-9e87af930566 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:38.340103 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-ff1e7a18-69f9-442b-a045-9e87af930566 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:38.341834 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-ff1e7a18-69f9-442b-a045-9e87af930566 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1281 microversion: 2.20 time: 0.079499 Jun 22 08:58:38.342515 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 32/59] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:58:38 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1281 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:58:38.346983 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-cd5ae7bb-57da-47fe-9796-104b4b33a1b8 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:38.347604 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-cd5ae7bb-57da-47fe-9796-104b4b33a1b8 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:38.349903 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-6d92238c-cc09-4774-8529-840f50e9cd37 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:38.354742 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cd5ae7bb-57da-47fe-9796-104b4b33a1b8 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:38.355273 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cd5ae7bb-57da-47fe-9796-104b4b33a1b8 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:38.356078 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cd5ae7bb-57da-47fe-9796-104b4b33a1b8 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:38.356719 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cd5ae7bb-57da-47fe-9796-104b4b33a1b8 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:38.358795 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-6d92238c-cc09-4774-8529-840f50e9cd37 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1301 microversion: 2.1 time: 0.119504 Jun 22 08:58:38.359421 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 28/60] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:38 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1301 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:38.422721 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [req-86d980de-218b-4178-b21d-72f695c2dd49 req-08478622-f964-465b-bdf9-e1de4cc5411b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "699207bb-360b-451e-85ee-a5cc21227d44", "tag": "795afac5-e2d6-479f-b9e5-8f401a2994c0"}]} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:58:38.432987 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-86d980de-218b-4178-b21d-72f695c2dd49 req-08478622-f964-465b-bdf9-e1de4cc5411b service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:38.433763 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-86d980de-218b-4178-b21d-72f695c2dd49 req-08478622-f964-465b-bdf9-e1de4cc5411b service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:38.447491 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.compute.server_external_events [req-86d980de-218b-4178-b21d-72f695c2dd49 req-08478622-f964-465b-bdf9-e1de4cc5411b service nova] Creating event network-changed:795afac5-e2d6-479f-b9e5-8f401a2994c0 for instance 699207bb-360b-451e-85ee-a5cc21227d44 on hv-cinder-84599 Jun 22 08:58:38.453974 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [req-86d980de-218b-4178-b21d-72f695c2dd49 req-08478622-f964-465b-bdf9-e1de4cc5411b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093301 Jun 22 08:58:38.454594 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 29/61] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 08:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:58:38.495083 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-cd5ae7bb-57da-47fe-9796-104b4b33a1b8 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:38.502875 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-cd5ae7bb-57da-47fe-9796-104b4b33a1b8 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1314 microversion: 2.1 time: 0.159383 Jun 22 08:58:38.503448 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 33/62] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:38 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:39.257789 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-d9691311-354b-4df8-b9f2-de38bc234d6c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:39.257789 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-d9691311-354b-4df8-b9f2-de38bc234d6c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:39.262688 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d9691311-354b-4df8-b9f2-de38bc234d6c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:39.263143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d9691311-354b-4df8-b9f2-de38bc234d6c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:39.263914 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d9691311-354b-4df8-b9f2-de38bc234d6c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:39.264350 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d9691311-354b-4df8-b9f2-de38bc234d6c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:39.279130 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-4b693387-c087-43a2-a7e6-2830dd09816b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:39.279911 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-4b693387-c087-43a2-a7e6-2830dd09816b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:39.297215 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4b693387-c087-43a2-a7e6-2830dd09816b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:39.298660 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4b693387-c087-43a2-a7e6-2830dd09816b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:39.300486 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4b693387-c087-43a2-a7e6-2830dd09816b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:39.304604 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4b693387-c087-43a2-a7e6-2830dd09816b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:39.539096 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-d9691311-354b-4df8-b9f2-de38bc234d6c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:39.543181 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-4b693387-c087-43a2-a7e6-2830dd09816b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:39.547620 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=100 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:58:39.547925 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-d9691311-354b-4df8-b9f2-de38bc234d6c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.296799 Jun 22 08:58:39.549510 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 30/63] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:39 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:39.563080 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-092d7cc2-e0b2-4ea7-949e-105094edc23b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:39.563804 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-092d7cc2-e0b2-4ea7-949e-105094edc23b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:39.574820 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-4b693387-c087-43a2-a7e6-2830dd09816b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.300094 Jun 22 08:58:39.575471 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 34/64] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:39 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:39.586825 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-30bd0e86-07e9-489b-abc6-978446b6cd41 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:39.588384 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-30bd0e86-07e9-489b-abc6-978446b6cd41 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:39.595053 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-30bd0e86-07e9-489b-abc6-978446b6cd41 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:39.595508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-30bd0e86-07e9-489b-abc6-978446b6cd41 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:39.596272 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-30bd0e86-07e9-489b-abc6-978446b6cd41 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:39.596708 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-30bd0e86-07e9-489b-abc6-978446b6cd41 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:39.625176 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-092d7cc2-e0b2-4ea7-949e-105094edc23b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:39.632835 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-092d7cc2-e0b2-4ea7-949e-105094edc23b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:39.634517 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-092d7cc2-e0b2-4ea7-949e-105094edc23b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:39.635635 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-092d7cc2-e0b2-4ea7-949e-105094edc23b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1281 microversion: 2.20 time: 0.084969 Jun 22 08:58:39.636515 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 31/65] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:58:39 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1281 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:58:39.645590 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-92b18296-1bed-4781-9728-db2deee1b2f5 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:39.646413 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-92b18296-1bed-4781-9728-db2deee1b2f5 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:39.653545 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-92b18296-1bed-4781-9728-db2deee1b2f5 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:39.654009 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-92b18296-1bed-4781-9728-db2deee1b2f5 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:39.654784 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-92b18296-1bed-4781-9728-db2deee1b2f5 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:39.655297 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-92b18296-1bed-4781-9728-db2deee1b2f5 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:39.665471 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-30bd0e86-07e9-489b-abc6-978446b6cd41 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:39.688626 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-30bd0e86-07e9-489b-abc6-978446b6cd41 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1301 microversion: 2.1 time: 0.091965 Jun 22 08:58:39.688626 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 35/66] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:39 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1301 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:39.688626 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-0c00ccd8-f822-4e53-b425-2e2d5a84cb8a req-80e0245d-5860-4141-8da3-b8e51e3b0475 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eefd03e-9e6e-4710-b228-b87c5ddf475f", "tag": "7e660c9a-428c-40ae-95a2-99c74d79d984"}, {"name": "network-changed", "server_uuid": "b84e6922-9b60-4a6d-8836-4b07ef206590", "tag": "e4f8b1de-c427-4428-a8a5-28fa99c60cba"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:58:39.695444 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-0c00ccd8-f822-4e53-b425-2e2d5a84cb8a req-80e0245d-5860-4141-8da3-b8e51e3b0475 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:39.695889 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-0c00ccd8-f822-4e53-b425-2e2d5a84cb8a req-80e0245d-5860-4141-8da3-b8e51e3b0475 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:39.719484 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-0c00ccd8-f822-4e53-b425-2e2d5a84cb8a req-80e0245d-5860-4141-8da3-b8e51e3b0475 service nova] Creating event network-changed:7e660c9a-428c-40ae-95a2-99c74d79d984 for instance 8eefd03e-9e6e-4710-b228-b87c5ddf475f on hv-cinder-84599 Jun 22 08:58:39.719989 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-0c00ccd8-f822-4e53-b425-2e2d5a84cb8a req-80e0245d-5860-4141-8da3-b8e51e3b0475 service nova] Creating event network-changed:e4f8b1de-c427-4428-a8a5-28fa99c60cba for instance b84e6922-9b60-4a6d-8836-4b07ef206590 on hv-cinder-84599 Jun 22 08:58:39.720523 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-0c00ccd8-f822-4e53-b425-2e2d5a84cb8a req-80e0245d-5860-4141-8da3-b8e51e3b0475 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118025) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 22 08:58:39.721653 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0f9a43f0-bd4e-4354-aed0-5d3653f884c9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:39.722091 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0f9a43f0-bd4e-4354-aed0-5d3653f884c9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:39.722870 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0f9a43f0-bd4e-4354-aed0-5d3653f884c9 None None] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:39.723308 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0f9a43f0-bd4e-4354-aed0-5d3653f884c9 None None] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:39.732536 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.compute.rpcapi [None req-0f9a43f0-bd4e-4354-aed0-5d3653f884c9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 22 08:58:39.733449 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0f9a43f0-bd4e-4354-aed0-5d3653f884c9 None None] Releasing lock "compute-rpcapi-router" {{(pid=118025) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 22 08:58:39.750992 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-0f9a43f0-bd4e-4354-aed0-5d3653f884c9 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.075248 Jun 22 08:58:39.751645 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 36/67] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 08:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:58:39.885850 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-92b18296-1bed-4781-9728-db2deee1b2f5 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:39.893868 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-92b18296-1bed-4781-9728-db2deee1b2f5 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1314 microversion: 2.1 time: 0.256286 Jun 22 08:58:39.894448 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 32/68] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:39 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:40.567501 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-acf780eb-b085-4a95-a69f-29ef8d986c15 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:40.568289 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-acf780eb-b085-4a95-a69f-29ef8d986c15 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:40.574808 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-acf780eb-b085-4a95-a69f-29ef8d986c15 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:40.578794 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-acf780eb-b085-4a95-a69f-29ef8d986c15 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:40.578794 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-acf780eb-b085-4a95-a69f-29ef8d986c15 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:40.578794 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-acf780eb-b085-4a95-a69f-29ef8d986c15 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:40.592223 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-0a099e50-9197-45a3-8268-61ee712a9fd0 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:40.592906 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-0a099e50-9197-45a3-8268-61ee712a9fd0 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:40.599022 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0a099e50-9197-45a3-8268-61ee712a9fd0 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:40.599469 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0a099e50-9197-45a3-8268-61ee712a9fd0 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:40.600520 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0a099e50-9197-45a3-8268-61ee712a9fd0 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:40.600983 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0a099e50-9197-45a3-8268-61ee712a9fd0 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:40.776531 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-acf780eb-b085-4a95-a69f-29ef8d986c15 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:40.781484 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-acf780eb-b085-4a95-a69f-29ef8d986c15 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.219041 Jun 22 08:58:40.782062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 37/69] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:40 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:40.785530 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-0a099e50-9197-45a3-8268-61ee712a9fd0 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:40.786610 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9bd22adb-3472-4b7b-95ae-5a0a0ea53a4f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:40.787222 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9bd22adb-3472-4b7b-95ae-5a0a0ea53a4f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:40.793104 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9bd22adb-3472-4b7b-95ae-5a0a0ea53a4f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:40.793576 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9bd22adb-3472-4b7b-95ae-5a0a0ea53a4f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:40.794546 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-0a099e50-9197-45a3-8268-61ee712a9fd0 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.206040 Jun 22 08:58:40.794823 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9bd22adb-3472-4b7b-95ae-5a0a0ea53a4f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:40.795141 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 33/70] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:40 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:40.795260 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9bd22adb-3472-4b7b-95ae-5a0a0ea53a4f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:40.800524 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-9c016ede-fff7-4ebd-9e6b-3a24f7a05893 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:40.800524 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-9c016ede-fff7-4ebd-9e6b-3a24f7a05893 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:40.806333 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9c016ede-fff7-4ebd-9e6b-3a24f7a05893 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:40.806781 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9c016ede-fff7-4ebd-9e6b-3a24f7a05893 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:40.808348 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9c016ede-fff7-4ebd-9e6b-3a24f7a05893 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:40.808348 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9c016ede-fff7-4ebd-9e6b-3a24f7a05893 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:40.859138 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9bd22adb-3472-4b7b-95ae-5a0a0ea53a4f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:40.869927 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9bd22adb-3472-4b7b-95ae-5a0a0ea53a4f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:40.870650 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9bd22adb-3472-4b7b-95ae-5a0a0ea53a4f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:40.871878 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9bd22adb-3472-4b7b-95ae-5a0a0ea53a4f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1285 microversion: 2.20 time: 0.088783 Jun 22 08:58:40.873254 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 38/71] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:58:40 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:58:40.886159 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-9c016ede-fff7-4ebd-9e6b-3a24f7a05893 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:40.894304 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-9c016ede-fff7-4ebd-9e6b-3a24f7a05893 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1301 microversion: 2.1 time: 0.098167 Jun 22 08:58:40.898369 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 34/72] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:40 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1301 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:40.910174 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7573cf8a-1e8e-4316-b792-f42b25bdb259 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:40.910790 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7573cf8a-1e8e-4316-b792-f42b25bdb259 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:40.916846 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7573cf8a-1e8e-4316-b792-f42b25bdb259 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:40.917210 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7573cf8a-1e8e-4316-b792-f42b25bdb259 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:40.918150 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7573cf8a-1e8e-4316-b792-f42b25bdb259 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:40.918600 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7573cf8a-1e8e-4316-b792-f42b25bdb259 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:41.051625 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7573cf8a-1e8e-4316-b792-f42b25bdb259 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:41.059787 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7573cf8a-1e8e-4316-b792-f42b25bdb259 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1314 microversion: 2.1 time: 0.153178 Jun 22 08:58:41.060757 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 39/73] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:40 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:41.798600 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-729b7cf1-c847-427c-a324-49f626b4990c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:41.799221 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-729b7cf1-c847-427c-a324-49f626b4990c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:41.805288 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-729b7cf1-c847-427c-a324-49f626b4990c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:41.805735 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-729b7cf1-c847-427c-a324-49f626b4990c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:41.806600 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-729b7cf1-c847-427c-a324-49f626b4990c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:41.807042 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-729b7cf1-c847-427c-a324-49f626b4990c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:41.812744 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7388a7e8-e94e-4792-a03c-e671ff56898e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:41.816852 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7388a7e8-e94e-4792-a03c-e671ff56898e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:41.823712 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7388a7e8-e94e-4792-a03c-e671ff56898e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:41.824163 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7388a7e8-e94e-4792-a03c-e671ff56898e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:41.825087 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7388a7e8-e94e-4792-a03c-e671ff56898e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:41.826163 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7388a7e8-e94e-4792-a03c-e671ff56898e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:42.021775 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-729b7cf1-c847-427c-a324-49f626b4990c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:42.024650 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7388a7e8-e94e-4792-a03c-e671ff56898e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:42.029854 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-729b7cf1-c847-427c-a324-49f626b4990c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.235070 Jun 22 08:58:42.030638 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 35/74] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:41 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:42.040664 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7388a7e8-e94e-4792-a03c-e671ff56898e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.232805 Jun 22 08:58:42.041504 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 40/75] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:41 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:42.042058 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-8a160269-21eb-4e0d-8e9b-df94af95a30f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:42.042988 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-8a160269-21eb-4e0d-8e9b-df94af95a30f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:42.047013 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7e6cc408-d3a4-4401-b1c7-bdb674e89e78 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:42.047747 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7e6cc408-d3a4-4401-b1c7-bdb674e89e78 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:42.051434 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8a160269-21eb-4e0d-8e9b-df94af95a30f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:42.051906 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8a160269-21eb-4e0d-8e9b-df94af95a30f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:42.052799 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8a160269-21eb-4e0d-8e9b-df94af95a30f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:42.053863 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8a160269-21eb-4e0d-8e9b-df94af95a30f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:42.054357 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7e6cc408-d3a4-4401-b1c7-bdb674e89e78 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:42.054915 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7e6cc408-d3a4-4401-b1c7-bdb674e89e78 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:42.055716 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7e6cc408-d3a4-4401-b1c7-bdb674e89e78 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:42.056157 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7e6cc408-d3a4-4401-b1c7-bdb674e89e78 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:42.146775 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7e6cc408-d3a4-4401-b1c7-bdb674e89e78 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:42.151983 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-8a160269-21eb-4e0d-8e9b-df94af95a30f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:42.154695 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7e6cc408-d3a4-4401-b1c7-bdb674e89e78 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1301 microversion: 2.1 time: 0.112093 Jun 22 08:58:42.155269 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 41/76] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:42 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1301 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:42.161043 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-29f0d579-b397-43aa-b5fe-273400544e36 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:42.164174 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-29f0d579-b397-43aa-b5fe-273400544e36 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:42.164280 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-8a160269-21eb-4e0d-8e9b-df94af95a30f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:42.164280 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-8a160269-21eb-4e0d-8e9b-df94af95a30f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:42.165466 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-8a160269-21eb-4e0d-8e9b-df94af95a30f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1285 microversion: 2.20 time: 0.133698 Jun 22 08:58:42.166019 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 36/77] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:58:42 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:58:42.168064 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-29f0d579-b397-43aa-b5fe-273400544e36 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:42.169535 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-29f0d579-b397-43aa-b5fe-273400544e36 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:42.170584 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-29f0d579-b397-43aa-b5fe-273400544e36 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:42.171226 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-29f0d579-b397-43aa-b5fe-273400544e36 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:42.308054 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-29f0d579-b397-43aa-b5fe-273400544e36 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:42.314951 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-29f0d579-b397-43aa-b5fe-273400544e36 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1314 microversion: 2.1 time: 0.158515 Jun 22 08:58:42.315556 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 42/78] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:42 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:43.047368 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a52fa549-5e16-431d-9a90-a0af35d23c58 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:43.048111 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a52fa549-5e16-431d-9a90-a0af35d23c58 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:43.055189 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a52fa549-5e16-431d-9a90-a0af35d23c58 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:43.055639 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a52fa549-5e16-431d-9a90-a0af35d23c58 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:43.056483 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a52fa549-5e16-431d-9a90-a0af35d23c58 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:43.056869 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a52fa549-5e16-431d-9a90-a0af35d23c58 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:43.058216 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-617c7514-3fb1-4b06-a57e-d396e28e8841 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:43.058827 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-617c7514-3fb1-4b06-a57e-d396e28e8841 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:43.063492 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=99 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:58:43.071168 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-617c7514-3fb1-4b06-a57e-d396e28e8841 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:43.071700 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-617c7514-3fb1-4b06-a57e-d396e28e8841 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:43.072554 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-617c7514-3fb1-4b06-a57e-d396e28e8841 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:43.073107 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-617c7514-3fb1-4b06-a57e-d396e28e8841 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:43.272568 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-a52fa549-5e16-431d-9a90-a0af35d23c58 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:43.280106 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a52fa549-5e16-431d-9a90-a0af35d23c58 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.236702 Jun 22 08:58:43.281476 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 37/79] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:43 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:43.285197 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-0d11da88-79e9-44ee-9147-60fa9e6967fe tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:43.285804 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-0d11da88-79e9-44ee-9147-60fa9e6967fe tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:43.291752 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0d11da88-79e9-44ee-9147-60fa9e6967fe tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:43.292477 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0d11da88-79e9-44ee-9147-60fa9e6967fe tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:43.293288 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0d11da88-79e9-44ee-9147-60fa9e6967fe tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:43.293761 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0d11da88-79e9-44ee-9147-60fa9e6967fe tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:43.295393 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-617c7514-3fb1-4b06-a57e-d396e28e8841 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:43.303183 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-617c7514-3fb1-4b06-a57e-d396e28e8841 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.248658 Jun 22 08:58:43.303698 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 43/80] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:43 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:43.308911 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e776c0fe-cb8d-45db-94d3-b0f55ea65fd3 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:43.327066 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e776c0fe-cb8d-45db-94d3-b0f55ea65fd3 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:43.327066 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e776c0fe-cb8d-45db-94d3-b0f55ea65fd3 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:43.327066 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e776c0fe-cb8d-45db-94d3-b0f55ea65fd3 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:43.327066 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e776c0fe-cb8d-45db-94d3-b0f55ea65fd3 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:43.327438 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e776c0fe-cb8d-45db-94d3-b0f55ea65fd3 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:43.367303 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-0d11da88-79e9-44ee-9147-60fa9e6967fe tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:43.369202 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-0d11da88-79e9-44ee-9147-60fa9e6967fe tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1301 microversion: 2.1 time: 0.087453 Jun 22 08:58:43.369776 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 38/81] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:43 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1301 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:43.379480 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3072c190-77e7-4525-8c45-05deb1c17a15 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:43.380927 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3072c190-77e7-4525-8c45-05deb1c17a15 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:43.402159 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-e776c0fe-cb8d-45db-94d3-b0f55ea65fd3 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:43.407517 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3072c190-77e7-4525-8c45-05deb1c17a15 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:43.407517 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3072c190-77e7-4525-8c45-05deb1c17a15 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:43.407517 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3072c190-77e7-4525-8c45-05deb1c17a15 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:43.407517 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3072c190-77e7-4525-8c45-05deb1c17a15 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:43.417651 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-e776c0fe-cb8d-45db-94d3-b0f55ea65fd3 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:43.419542 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-e776c0fe-cb8d-45db-94d3-b0f55ea65fd3 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:43.420928 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e776c0fe-cb8d-45db-94d3-b0f55ea65fd3 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1285 microversion: 2.20 time: 0.116109 Jun 22 08:58:43.421701 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 44/82] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:58:43 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:58:43.562049 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3072c190-77e7-4525-8c45-05deb1c17a15 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:43.571080 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3072c190-77e7-4525-8c45-05deb1c17a15 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1314 microversion: 2.1 time: 0.200245 Jun 22 08:58:43.571664 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 39/83] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:43 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:44.303793 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-83c7685e-337a-46df-bb49-3ba056a7c994 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:44.307754 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-83c7685e-337a-46df-bb49-3ba056a7c994 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:44.316408 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-83c7685e-337a-46df-bb49-3ba056a7c994 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:44.317705 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-83c7685e-337a-46df-bb49-3ba056a7c994 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:44.318863 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-83c7685e-337a-46df-bb49-3ba056a7c994 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:44.319540 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-83c7685e-337a-46df-bb49-3ba056a7c994 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:44.323573 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6bb9ee1c-10cd-4a2f-b125-f6825f2e4a58 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:44.328600 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-6bb9ee1c-10cd-4a2f-b125-f6825f2e4a58 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:44.330614 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6bb9ee1c-10cd-4a2f-b125-f6825f2e4a58 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:44.331062 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6bb9ee1c-10cd-4a2f-b125-f6825f2e4a58 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:44.331824 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6bb9ee1c-10cd-4a2f-b125-f6825f2e4a58 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:44.332258 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6bb9ee1c-10cd-4a2f-b125-f6825f2e4a58 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:44.532382 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-83c7685e-337a-46df-bb49-3ba056a7c994 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:44.535943 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-6bb9ee1c-10cd-4a2f-b125-f6825f2e4a58 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:44.545069 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-6bb9ee1c-10cd-4a2f-b125-f6825f2e4a58 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.226574 Jun 22 08:58:44.546120 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 40/84] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:44 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:58:44.550827 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b6c952bc-af13-4e92-9f43-ed4421ec0fee tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:44.551692 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-b6c952bc-af13-4e92-9f43-ed4421ec0fee tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:44.560357 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-83c7685e-337a-46df-bb49-3ba056a7c994 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.262861 Jun 22 08:58:44.560357 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 45/85] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:44 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:44.562900 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b6c952bc-af13-4e92-9f43-ed4421ec0fee tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:44.563612 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b6c952bc-af13-4e92-9f43-ed4421ec0fee tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:44.563831 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-013d7a9d-e556-4256-989f-7c44e4d4c373 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:44.564621 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-013d7a9d-e556-4256-989f-7c44e4d4c373 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:44.564856 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b6c952bc-af13-4e92-9f43-ed4421ec0fee tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:44.565401 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b6c952bc-af13-4e92-9f43-ed4421ec0fee tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:44.571797 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-013d7a9d-e556-4256-989f-7c44e4d4c373 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:44.572673 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-013d7a9d-e556-4256-989f-7c44e4d4c373 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:44.573764 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-013d7a9d-e556-4256-989f-7c44e4d4c373 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:44.574344 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-013d7a9d-e556-4256-989f-7c44e4d4c373 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:44.664614 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-b6c952bc-af13-4e92-9f43-ed4421ec0fee tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:44.666734 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-013d7a9d-e556-4256-989f-7c44e4d4c373 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:44.675430 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-b6c952bc-af13-4e92-9f43-ed4421ec0fee tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1301 microversion: 2.1 time: 0.128138 Jun 22 08:58:44.680836 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 41/86] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:44 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1301 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:44.680946 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-013d7a9d-e556-4256-989f-7c44e4d4c373 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:44.681113 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-d50f87b5-3bec-4eae-9d10-a7f1d4942499 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:44.681737 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-d50f87b5-3bec-4eae-9d10-a7f1d4942499 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:44.683906 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-013d7a9d-e556-4256-989f-7c44e4d4c373 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:44.685653 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-013d7a9d-e556-4256-989f-7c44e4d4c373 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1285 microversion: 2.20 time: 0.126553 Jun 22 08:58:44.688829 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d50f87b5-3bec-4eae-9d10-a7f1d4942499 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:44.689492 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d50f87b5-3bec-4eae-9d10-a7f1d4942499 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:44.689917 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 46/87] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:58:44 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1285 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:58:44.690479 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d50f87b5-3bec-4eae-9d10-a7f1d4942499 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:44.691141 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d50f87b5-3bec-4eae-9d10-a7f1d4942499 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:44.852381 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-d50f87b5-3bec-4eae-9d10-a7f1d4942499 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:44.852381 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-d50f87b5-3bec-4eae-9d10-a7f1d4942499 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1314 microversion: 2.1 time: 0.173609 Jun 22 08:58:44.852381 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 42/88] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:44 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:45.562765 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-0d1029d2-243e-4298-a18f-a6eb897a2491 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:45.563385 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-0d1029d2-243e-4298-a18f-a6eb897a2491 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:45.569536 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0d1029d2-243e-4298-a18f-a6eb897a2491 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:45.569993 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0d1029d2-243e-4298-a18f-a6eb897a2491 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:45.570831 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0d1029d2-243e-4298-a18f-a6eb897a2491 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:45.571275 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0d1029d2-243e-4298-a18f-a6eb897a2491 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:45.575675 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-0ee8f4de-52a6-4c91-ba46-ca3b95357ca1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:45.576305 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-0ee8f4de-52a6-4c91-ba46-ca3b95357ca1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:45.583174 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0ee8f4de-52a6-4c91-ba46-ca3b95357ca1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:45.583627 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0ee8f4de-52a6-4c91-ba46-ca3b95357ca1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:45.584396 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0ee8f4de-52a6-4c91-ba46-ca3b95357ca1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:45.584914 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0ee8f4de-52a6-4c91-ba46-ca3b95357ca1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:45.772487 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-0ee8f4de-52a6-4c91-ba46-ca3b95357ca1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:45.777666 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-0d1029d2-243e-4298-a18f-a6eb897a2491 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:45.781193 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-0ee8f4de-52a6-4c91-ba46-ca3b95357ca1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.209600 Jun 22 08:58:45.781895 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 43/89] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:45 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:58:45.786841 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-4222134b-6003-4866-a1d1-d813e91c24dc tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:45.796215 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-4222134b-6003-4866-a1d1-d813e91c24dc tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:45.796359 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-0d1029d2-243e-4298-a18f-a6eb897a2491 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.231415 Jun 22 08:58:45.796359 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 47/90] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:45 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:45.796534 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4222134b-6003-4866-a1d1-d813e91c24dc tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:45.796534 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4222134b-6003-4866-a1d1-d813e91c24dc tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:45.796695 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c328afdc-be9e-4d89-9ce7-cfdb0d24b017 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:45.796818 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4222134b-6003-4866-a1d1-d813e91c24dc tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:45.796903 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c328afdc-be9e-4d89-9ce7-cfdb0d24b017 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:45.796992 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4222134b-6003-4866-a1d1-d813e91c24dc tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:45.801668 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c328afdc-be9e-4d89-9ce7-cfdb0d24b017 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:45.802132 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c328afdc-be9e-4d89-9ce7-cfdb0d24b017 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:45.802907 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c328afdc-be9e-4d89-9ce7-cfdb0d24b017 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:45.803359 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c328afdc-be9e-4d89-9ce7-cfdb0d24b017 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:45.866250 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-4222134b-6003-4866-a1d1-d813e91c24dc tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:45.874409 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-4222134b-6003-4866-a1d1-d813e91c24dc tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1301 microversion: 2.1 time: 0.091248 Jun 22 08:58:45.874980 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 44/91] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:45 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1301 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:45.881934 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c328afdc-be9e-4d89-9ce7-cfdb0d24b017 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:45.896210 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c328afdc-be9e-4d89-9ce7-cfdb0d24b017 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:45.896210 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c328afdc-be9e-4d89-9ce7-cfdb0d24b017 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:45.896210 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c328afdc-be9e-4d89-9ce7-cfdb0d24b017 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1285 microversion: 2.20 time: 0.103970 Jun 22 08:58:45.900058 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-49d41b9e-dd3d-45de-8d69-8a139990db36 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:45.901013 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-49d41b9e-dd3d-45de-8d69-8a139990db36 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:45.906573 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 48/92] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:58:45 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:58:45.908675 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-49d41b9e-dd3d-45de-8d69-8a139990db36 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:45.909172 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-49d41b9e-dd3d-45de-8d69-8a139990db36 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:45.909964 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-49d41b9e-dd3d-45de-8d69-8a139990db36 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:45.910392 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-49d41b9e-dd3d-45de-8d69-8a139990db36 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:46.052187 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-49d41b9e-dd3d-45de-8d69-8a139990db36 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:46.059939 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-49d41b9e-dd3d-45de-8d69-8a139990db36 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1314 microversion: 2.1 time: 0.164123 Jun 22 08:58:46.060507 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 45/93] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:45 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:58:46.799067 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d84d9fb9-f7b9-4ea7-97f8-f8d39ad139b9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:46.799690 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-d84d9fb9-f7b9-4ea7-97f8-f8d39ad139b9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:46.813226 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d84d9fb9-f7b9-4ea7-97f8-f8d39ad139b9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:46.815253 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d84d9fb9-f7b9-4ea7-97f8-f8d39ad139b9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:46.816108 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d84d9fb9-f7b9-4ea7-97f8-f8d39ad139b9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:46.816554 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d84d9fb9-f7b9-4ea7-97f8-f8d39ad139b9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:46.823385 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a62a4c5c-269b-4a73-b674-382f7dee46d5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:46.824026 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a62a4c5c-269b-4a73-b674-382f7dee46d5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:46.844296 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a62a4c5c-269b-4a73-b674-382f7dee46d5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:46.845196 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a62a4c5c-269b-4a73-b674-382f7dee46d5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:46.848381 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a62a4c5c-269b-4a73-b674-382f7dee46d5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:46.851593 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a62a4c5c-269b-4a73-b674-382f7dee46d5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:47.115205 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-d84d9fb9-f7b9-4ea7-97f8-f8d39ad139b9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:47.119540 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d84d9fb9-f7b9-4ea7-97f8-f8d39ad139b9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.324882 Jun 22 08:58:47.120338 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 49/94] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:46 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:47.125661 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-943b800f-8081-4f97-8940-31d70e9fcb54 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:47.126514 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-943b800f-8081-4f97-8940-31d70e9fcb54 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:47.133187 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-943b800f-8081-4f97-8940-31d70e9fcb54 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:47.133941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-943b800f-8081-4f97-8940-31d70e9fcb54 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:47.135050 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-943b800f-8081-4f97-8940-31d70e9fcb54 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:47.135671 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-943b800f-8081-4f97-8940-31d70e9fcb54 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:47.142108 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-a62a4c5c-269b-4a73-b674-382f7dee46d5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:47.152486 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a62a4c5c-269b-4a73-b674-382f7dee46d5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.343592 Jun 22 08:58:47.164579 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 46/95] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:46 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:47.164579 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a58a097b-fd52-4a45-b7c4-1be273656083 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:47.180533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a58a097b-fd52-4a45-b7c4-1be273656083 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:47.200592 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a58a097b-fd52-4a45-b7c4-1be273656083 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:47.201226 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a58a097b-fd52-4a45-b7c4-1be273656083 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:47.202240 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a58a097b-fd52-4a45-b7c4-1be273656083 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:47.202678 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a58a097b-fd52-4a45-b7c4-1be273656083 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:47.238712 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-943b800f-8081-4f97-8940-31d70e9fcb54 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:47.250929 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-943b800f-8081-4f97-8940-31d70e9fcb54 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1311 microversion: 2.1 time: 0.129297 Jun 22 08:58:47.252537 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 50/96] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:47 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1311 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:47.258866 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-bbbb6204-c7ff-4732-9ecc-c84249eeba8d tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:47.259548 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-bbbb6204-c7ff-4732-9ecc-c84249eeba8d tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:47.266711 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bbbb6204-c7ff-4732-9ecc-c84249eeba8d tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:47.267380 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bbbb6204-c7ff-4732-9ecc-c84249eeba8d tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:47.268225 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bbbb6204-c7ff-4732-9ecc-c84249eeba8d tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:47.268730 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bbbb6204-c7ff-4732-9ecc-c84249eeba8d tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:47.307082 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-a58a097b-fd52-4a45-b7c4-1be273656083 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:47.316086 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-a58a097b-fd52-4a45-b7c4-1be273656083 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:47.317654 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-a58a097b-fd52-4a45-b7c4-1be273656083 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:47.318813 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a58a097b-fd52-4a45-b7c4-1be273656083 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1277 microversion: 2.20 time: 0.160897 Jun 22 08:58:47.319390 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 47/97] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:58:47 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:58:47.450112 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-bbbb6204-c7ff-4732-9ecc-c84249eeba8d tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:47.454673 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=100 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:58:47.459253 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-bbbb6204-c7ff-4732-9ecc-c84249eeba8d tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1314 microversion: 2.1 time: 0.204120 Jun 22 08:58:47.460007 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 51/98] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:47 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:48.137165 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-248dc66e-91ff-413c-850f-09463a3e7336 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:48.137716 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-248dc66e-91ff-413c-850f-09463a3e7336 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:48.140106 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell0:SELECT=10 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:58:48.145091 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-248dc66e-91ff-413c-850f-09463a3e7336 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:48.145554 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-248dc66e-91ff-413c-850f-09463a3e7336 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:48.146326 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-248dc66e-91ff-413c-850f-09463a3e7336 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:48.146771 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-248dc66e-91ff-413c-850f-09463a3e7336 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:48.171871 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-cf7134c5-ef9f-40b6-9509-23bfa1f0cd9e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:48.172487 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-cf7134c5-ef9f-40b6-9509-23bfa1f0cd9e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:48.178862 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cf7134c5-ef9f-40b6-9509-23bfa1f0cd9e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:48.179315 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cf7134c5-ef9f-40b6-9509-23bfa1f0cd9e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:48.180087 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cf7134c5-ef9f-40b6-9509-23bfa1f0cd9e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:48.180592 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cf7134c5-ef9f-40b6-9509-23bfa1f0cd9e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:48.335450 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell0:SELECT=8 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:58:48.349388 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-248dc66e-91ff-413c-850f-09463a3e7336 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:48.358888 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-248dc66e-91ff-413c-850f-09463a3e7336 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.225500 Jun 22 08:58:48.360995 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 48/99] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:48 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:48.361889 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-cf7134c5-ef9f-40b6-9509-23bfa1f0cd9e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:48.371432 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-cf7134c5-ef9f-40b6-9509-23bfa1f0cd9e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.202160 Jun 22 08:58:48.371432 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 52/100] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:48 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:48.376913 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-4cbd6e79-6cf9-41ac-893c-e8ac3f03d77c tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:48.378564 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-4cbd6e79-6cf9-41ac-893c-e8ac3f03d77c tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:48.378921 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9212871c-4601-4ed7-8220-661b31788bd1 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:48.379560 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9212871c-4601-4ed7-8220-661b31788bd1 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:48.385605 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9212871c-4601-4ed7-8220-661b31788bd1 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:48.386063 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9212871c-4601-4ed7-8220-661b31788bd1 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:48.386827 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9212871c-4601-4ed7-8220-661b31788bd1 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:48.387329 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9212871c-4601-4ed7-8220-661b31788bd1 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:48.390856 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4cbd6e79-6cf9-41ac-893c-e8ac3f03d77c tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:48.391558 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4cbd6e79-6cf9-41ac-893c-e8ac3f03d77c tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:48.392835 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4cbd6e79-6cf9-41ac-893c-e8ac3f03d77c tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:48.393590 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4cbd6e79-6cf9-41ac-893c-e8ac3f03d77c tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:48.491835 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-4cbd6e79-6cf9-41ac-893c-e8ac3f03d77c tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:48.496365 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9212871c-4601-4ed7-8220-661b31788bd1 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:48.503154 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-4cbd6e79-6cf9-41ac-893c-e8ac3f03d77c tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1311 microversion: 2.1 time: 0.140713 Jun 22 08:58:48.503929 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 49/101] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:48 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1311 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:48.505688 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9212871c-4601-4ed7-8220-661b31788bd1 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:48.507194 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9212871c-4601-4ed7-8220-661b31788bd1 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:48.508536 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9212871c-4601-4ed7-8220-661b31788bd1 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1277 microversion: 2.20 time: 0.137073 Jun 22 08:58:48.508645 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1ded98a3-0ede-46b9-a324-6f0fc83cd6b0 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:48.509101 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 53/102] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:58:48 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1277 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:58:48.512621 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1ded98a3-0ede-46b9-a324-6f0fc83cd6b0 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:48.516536 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1ded98a3-0ede-46b9-a324-6f0fc83cd6b0 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:48.517015 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1ded98a3-0ede-46b9-a324-6f0fc83cd6b0 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:48.517786 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1ded98a3-0ede-46b9-a324-6f0fc83cd6b0 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:48.518227 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1ded98a3-0ede-46b9-a324-6f0fc83cd6b0 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:48.704689 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-1ded98a3-0ede-46b9-a324-6f0fc83cd6b0 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:48.713477 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1ded98a3-0ede-46b9-a324-6f0fc83cd6b0 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1314 microversion: 2.1 time: 0.208475 Jun 22 08:58:48.714304 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 50/103] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:48 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:49.377648 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-834e5564-81aa-4494-8eef-745279ca84ac tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:49.378260 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-834e5564-81aa-4494-8eef-745279ca84ac tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:49.384561 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-834e5564-81aa-4494-8eef-745279ca84ac tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:49.385071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-834e5564-81aa-4494-8eef-745279ca84ac tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:49.387561 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-25833ce4-5569-4058-a553-984349818ccf tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:49.389527 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-25833ce4-5569-4058-a553-984349818ccf tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:49.389874 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-834e5564-81aa-4494-8eef-745279ca84ac tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:49.390090 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-834e5564-81aa-4494-8eef-745279ca84ac tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:49.397432 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-25833ce4-5569-4058-a553-984349818ccf tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:49.397878 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-25833ce4-5569-4058-a553-984349818ccf tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:49.398676 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-25833ce4-5569-4058-a553-984349818ccf tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:49.399241 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-25833ce4-5569-4058-a553-984349818ccf tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:49.634358 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell0:SELECT=38 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:58:49.730843 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell0:SELECT=4 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:58:49.945271 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-25833ce4-5569-4058-a553-984349818ccf tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:49.956308 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-834e5564-81aa-4494-8eef-745279ca84ac tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:49.957739 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-25833ce4-5569-4058-a553-984349818ccf tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.574407 Jun 22 08:58:49.958483 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 51/104] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:49 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:58:49.963898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-fb0e0759-2d86-4680-89e8-8fe8fd6b6d66 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:49.964588 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-fb0e0759-2d86-4680-89e8-8fe8fd6b6d66 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:49.971806 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fb0e0759-2d86-4680-89e8-8fe8fd6b6d66 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:49.972473 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fb0e0759-2d86-4680-89e8-8fe8fd6b6d66 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:49.973440 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fb0e0759-2d86-4680-89e8-8fe8fd6b6d66 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:49.989753 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fb0e0759-2d86-4680-89e8-8fe8fd6b6d66 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:49.989840 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-834e5564-81aa-4494-8eef-745279ca84ac tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.601370 Jun 22 08:58:49.989840 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 54/105] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:49 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:49.989840 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-3d5c6081-3d27-41e4-8d8f-7c2bb4a3dd5f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:49.989840 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-3d5c6081-3d27-41e4-8d8f-7c2bb4a3dd5f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:49.989840 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3d5c6081-3d27-41e4-8d8f-7c2bb4a3dd5f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:49.990261 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3d5c6081-3d27-41e4-8d8f-7c2bb4a3dd5f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:49.990261 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3d5c6081-3d27-41e4-8d8f-7c2bb4a3dd5f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:49.990261 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3d5c6081-3d27-41e4-8d8f-7c2bb4a3dd5f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:50.054018 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-fb0e0759-2d86-4680-89e8-8fe8fd6b6d66 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:50.070681 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-fb0e0759-2d86-4680-89e8-8fe8fd6b6d66 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1299 microversion: 2.1 time: 0.107319 Jun 22 08:58:50.072923 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 52/106] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:49 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1299 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:50.078406 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-9d5da888-761f-4017-9690-b05fdc11f998 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:50.079031 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-9d5da888-761f-4017-9690-b05fdc11f998 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:50.085524 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9d5da888-761f-4017-9690-b05fdc11f998 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:50.085980 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9d5da888-761f-4017-9690-b05fdc11f998 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:50.086753 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9d5da888-761f-4017-9690-b05fdc11f998 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:50.086866 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-3d5c6081-3d27-41e4-8d8f-7c2bb4a3dd5f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:50.087198 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9d5da888-761f-4017-9690-b05fdc11f998 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:50.096455 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-3d5c6081-3d27-41e4-8d8f-7c2bb4a3dd5f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:50.098099 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-3d5c6081-3d27-41e4-8d8f-7c2bb4a3dd5f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:50.099281 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-3d5c6081-3d27-41e4-8d8f-7c2bb4a3dd5f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1333 microversion: 2.20 time: 0.123210 Jun 22 08:58:50.099940 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 55/107] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:58:49 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1333 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:58:50.228590 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-9d5da888-761f-4017-9690-b05fdc11f998 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:50.231004 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=100 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:58:50.238753 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-9d5da888-761f-4017-9690-b05fdc11f998 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1314 microversion: 2.1 time: 0.164284 Jun 22 08:58:50.239779 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 53/108] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:50 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:50.975151 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-4c4ce296-e3bd-4521-b828-28b45fb44f79 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:50.975758 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-4c4ce296-e3bd-4521-b828-28b45fb44f79 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:50.982291 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4c4ce296-e3bd-4521-b828-28b45fb44f79 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:50.990182 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4c4ce296-e3bd-4521-b828-28b45fb44f79 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:50.990182 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4c4ce296-e3bd-4521-b828-28b45fb44f79 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:50.990182 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4c4ce296-e3bd-4521-b828-28b45fb44f79 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:50.997278 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-79f37dc2-3189-449f-bb1c-102b9edaa0c9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:50.997901 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-79f37dc2-3189-449f-bb1c-102b9edaa0c9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:51.005440 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-79f37dc2-3189-449f-bb1c-102b9edaa0c9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:51.006498 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-79f37dc2-3189-449f-bb1c-102b9edaa0c9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:51.007282 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-79f37dc2-3189-449f-bb1c-102b9edaa0c9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:51.008111 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-79f37dc2-3189-449f-bb1c-102b9edaa0c9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:51.197108 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-4c4ce296-e3bd-4521-b828-28b45fb44f79 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:51.214999 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-4c4ce296-e3bd-4521-b828-28b45fb44f79 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.234369 Jun 22 08:58:51.214999 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 56/109] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:50 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:51.214999 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-772dce07-00d5-42aa-b5f1-ee966b65fcbf tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:51.214999 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-772dce07-00d5-42aa-b5f1-ee966b65fcbf tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:51.221579 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-772dce07-00d5-42aa-b5f1-ee966b65fcbf tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:51.221579 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-772dce07-00d5-42aa-b5f1-ee966b65fcbf tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:51.221579 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-772dce07-00d5-42aa-b5f1-ee966b65fcbf tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:51.221579 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-772dce07-00d5-42aa-b5f1-ee966b65fcbf tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:51.221874 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-79f37dc2-3189-449f-bb1c-102b9edaa0c9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:51.231879 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-79f37dc2-3189-449f-bb1c-102b9edaa0c9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.237701 Jun 22 08:58:51.233744 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 54/110] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:50 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:51.240535 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-86d9760a-846a-4ed3-b0b4-45af7aeb2da8 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:51.241966 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-86d9760a-846a-4ed3-b0b4-45af7aeb2da8 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:51.254086 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-86d9760a-846a-4ed3-b0b4-45af7aeb2da8 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:51.254819 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-86d9760a-846a-4ed3-b0b4-45af7aeb2da8 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:51.255948 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-86d9760a-846a-4ed3-b0b4-45af7aeb2da8 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:51.256575 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-86d9760a-846a-4ed3-b0b4-45af7aeb2da8 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:51.300451 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-772dce07-00d5-42aa-b5f1-ee966b65fcbf tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:51.306129 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-772dce07-00d5-42aa-b5f1-ee966b65fcbf tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1299 microversion: 2.1 time: 0.098400 Jun 22 08:58:51.306742 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 57/111] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:51 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1299 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:51.314014 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7395ec80-b594-4cae-b033-67afdcec4fd5 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:51.314622 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7395ec80-b594-4cae-b033-67afdcec4fd5 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:51.320938 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7395ec80-b594-4cae-b033-67afdcec4fd5 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:51.321389 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7395ec80-b594-4cae-b033-67afdcec4fd5 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:51.322324 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7395ec80-b594-4cae-b033-67afdcec4fd5 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:51.322933 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7395ec80-b594-4cae-b033-67afdcec4fd5 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:51.347266 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-86d9760a-846a-4ed3-b0b4-45af7aeb2da8 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:51.356105 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-86d9760a-846a-4ed3-b0b4-45af7aeb2da8 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:51.357749 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-86d9760a-846a-4ed3-b0b4-45af7aeb2da8 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:51.358949 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-86d9760a-846a-4ed3-b0b4-45af7aeb2da8 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1333 microversion: 2.20 time: 0.123807 Jun 22 08:58:51.359802 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 55/112] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:58:51 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1333 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:58:51.459337 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7395ec80-b594-4cae-b033-67afdcec4fd5 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:51.466634 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7395ec80-b594-4cae-b033-67afdcec4fd5 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1314 microversion: 2.1 time: 0.158465 Jun 22 08:58:51.467194 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 58/113] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:51 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:52.224020 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-0b0b681e-26a5-491a-a818-059d0415c3a8 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:52.225117 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-0b0b681e-26a5-491a-a818-059d0415c3a8 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:52.235952 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0b0b681e-26a5-491a-a818-059d0415c3a8 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:52.237156 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0b0b681e-26a5-491a-a818-059d0415c3a8 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:52.238376 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0b0b681e-26a5-491a-a818-059d0415c3a8 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:52.241215 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0b0b681e-26a5-491a-a818-059d0415c3a8 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:52.257335 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-05c7eb6e-87bd-41c2-86b4-bbf101175912 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:52.257948 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-05c7eb6e-87bd-41c2-86b4-bbf101175912 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:52.268734 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-05c7eb6e-87bd-41c2-86b4-bbf101175912 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:52.269213 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-05c7eb6e-87bd-41c2-86b4-bbf101175912 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:52.269992 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-05c7eb6e-87bd-41c2-86b4-bbf101175912 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:52.270428 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-05c7eb6e-87bd-41c2-86b4-bbf101175912 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:52.613035 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-0b0b681e-26a5-491a-a818-059d0415c3a8 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:52.623613 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-0b0b681e-26a5-491a-a818-059d0415c3a8 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.404062 Jun 22 08:58:52.624214 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 56/114] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:52 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:52.633171 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-060888be-e9a8-430c-8225-bc8ac7887285 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:52.634047 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-060888be-e9a8-430c-8225-bc8ac7887285 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:52.644249 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-060888be-e9a8-430c-8225-bc8ac7887285 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:52.646613 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-060888be-e9a8-430c-8225-bc8ac7887285 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:52.646613 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-060888be-e9a8-430c-8225-bc8ac7887285 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:52.646613 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-060888be-e9a8-430c-8225-bc8ac7887285 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:52.728520 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-05c7eb6e-87bd-41c2-86b4-bbf101175912 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:52.741753 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-05c7eb6e-87bd-41c2-86b4-bbf101175912 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.488090 Jun 22 08:58:52.751192 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 59/115] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:52 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:52.756315 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-1aee7b6c-f538-48d9-bc3f-8172940a34cd tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:52.757199 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-1aee7b6c-f538-48d9-bc3f-8172940a34cd tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:52.764249 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1aee7b6c-f538-48d9-bc3f-8172940a34cd tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:52.765485 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1aee7b6c-f538-48d9-bc3f-8172940a34cd tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:52.766656 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1aee7b6c-f538-48d9-bc3f-8172940a34cd tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:52.767299 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1aee7b6c-f538-48d9-bc3f-8172940a34cd tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:52.870686 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-060888be-e9a8-430c-8225-bc8ac7887285 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:52.886773 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-1aee7b6c-f538-48d9-bc3f-8172940a34cd tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:52.896521 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-060888be-e9a8-430c-8225-bc8ac7887285 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1299 microversion: 2.1 time: 0.269786 Jun 22 08:58:52.898938 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 57/116] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:52 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1299 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:52.899650 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-1aee7b6c-f538-48d9-bc3f-8172940a34cd tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:52.903559 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-1aee7b6c-f538-48d9-bc3f-8172940a34cd tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:52.915993 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-1aee7b6c-f538-48d9-bc3f-8172940a34cd tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1351 microversion: 2.20 time: 0.163357 Jun 22 08:58:52.917833 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 60/117] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:58:52 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1351 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:58:52.929556 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-22e5d903-5d73-484b-8569-542ff233adf1 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:52.933786 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-22e5d903-5d73-484b-8569-542ff233adf1 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:52.954992 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-22e5d903-5d73-484b-8569-542ff233adf1 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:52.955463 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-22e5d903-5d73-484b-8569-542ff233adf1 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:52.956234 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-22e5d903-5d73-484b-8569-542ff233adf1 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:52.956677 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-22e5d903-5d73-484b-8569-542ff233adf1 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:53.273319 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-22e5d903-5d73-484b-8569-542ff233adf1 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:53.281840 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-22e5d903-5d73-484b-8569-542ff233adf1 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1314 microversion: 2.1 time: 0.381803 Jun 22 08:58:53.286308 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 58/118] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:52 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:53.641099 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-be04fad7-3a2c-4749-bdf2-07dbc4788e2b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:53.642263 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-be04fad7-3a2c-4749-bdf2-07dbc4788e2b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:53.648366 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-be04fad7-3a2c-4749-bdf2-07dbc4788e2b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:53.648806 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-be04fad7-3a2c-4749-bdf2-07dbc4788e2b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:53.654434 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-be04fad7-3a2c-4749-bdf2-07dbc4788e2b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:53.654434 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-be04fad7-3a2c-4749-bdf2-07dbc4788e2b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:53.758863 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-9181fc46-7764-484d-8943-7cab25473910 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:53.759546 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-9181fc46-7764-484d-8943-7cab25473910 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:53.765733 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9181fc46-7764-484d-8943-7cab25473910 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:53.766184 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9181fc46-7764-484d-8943-7cab25473910 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:53.766945 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9181fc46-7764-484d-8943-7cab25473910 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:53.767382 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9181fc46-7764-484d-8943-7cab25473910 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:53.784458 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-be04fad7-3a2c-4749-bdf2-07dbc4788e2b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:53.792653 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-be04fad7-3a2c-4749-bdf2-07dbc4788e2b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.156195 Jun 22 08:58:53.793736 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 61/119] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:53 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:53.916744 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-604e20cd-cfd3-4544-8ade-311cf0a9629d tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:53.922544 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-604e20cd-cfd3-4544-8ade-311cf0a9629d tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:53.927220 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-604e20cd-cfd3-4544-8ade-311cf0a9629d tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:53.928407 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-604e20cd-cfd3-4544-8ade-311cf0a9629d tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:53.929512 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-604e20cd-cfd3-4544-8ade-311cf0a9629d tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:53.930343 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-604e20cd-cfd3-4544-8ade-311cf0a9629d tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:53.991244 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-9181fc46-7764-484d-8943-7cab25473910 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:53.999397 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-9181fc46-7764-484d-8943-7cab25473910 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.244298 Jun 22 08:58:54.001170 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 59/120] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:53 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:58:54.018946 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-8b426fcd-13f0-4e2c-8328-5e8f78327487 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:54.036016 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-8b426fcd-13f0-4e2c-8328-5e8f78327487 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:54.058835 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8b426fcd-13f0-4e2c-8328-5e8f78327487 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:54.059289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8b426fcd-13f0-4e2c-8328-5e8f78327487 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:54.060065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8b426fcd-13f0-4e2c-8328-5e8f78327487 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:54.060501 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8b426fcd-13f0-4e2c-8328-5e8f78327487 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:54.189768 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-604e20cd-cfd3-4544-8ade-311cf0a9629d tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:54.193198 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-8b426fcd-13f0-4e2c-8328-5e8f78327487 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:54.206622 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-8b426fcd-13f0-4e2c-8328-5e8f78327487 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:54.209019 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-8b426fcd-13f0-4e2c-8328-5e8f78327487 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:54.210862 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-8b426fcd-13f0-4e2c-8328-5e8f78327487 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1339 microversion: 2.20 time: 0.207660 Jun 22 08:58:54.211967 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 60/121] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:58:54 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1339 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:58:54.215930 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-604e20cd-cfd3-4544-8ade-311cf0a9629d tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.295841 Jun 22 08:58:54.220938 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 62/122] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:53 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:58:54.312454 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b8ad5b08-653d-4e94-84fb-af0ca5213ba3 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:54.314879 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-b8ad5b08-653d-4e94-84fb-af0ca5213ba3 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:54.322440 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b8ad5b08-653d-4e94-84fb-af0ca5213ba3 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:54.323126 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b8ad5b08-653d-4e94-84fb-af0ca5213ba3 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:54.325221 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b8ad5b08-653d-4e94-84fb-af0ca5213ba3 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:54.325826 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b8ad5b08-653d-4e94-84fb-af0ca5213ba3 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:54.521607 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-b8ad5b08-653d-4e94-84fb-af0ca5213ba3 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:54.530949 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-b8ad5b08-653d-4e94-84fb-af0ca5213ba3 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1314 microversion: 2.1 time: 0.223272 Jun 22 08:58:54.531853 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 61/123] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:54 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:54.811540 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d273453a-f7e5-4a23-b9b8-8d1586023e33 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:54.812347 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-d273453a-f7e5-4a23-b9b8-8d1586023e33 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:54.823004 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d273453a-f7e5-4a23-b9b8-8d1586023e33 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:54.823468 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d273453a-f7e5-4a23-b9b8-8d1586023e33 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:54.824253 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d273453a-f7e5-4a23-b9b8-8d1586023e33 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:54.824695 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d273453a-f7e5-4a23-b9b8-8d1586023e33 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:55.009997 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-d273453a-f7e5-4a23-b9b8-8d1586023e33 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:55.018498 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-dce0ef90-d2f1-4465-b346-c3719d905327 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:55.018761 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d273453a-f7e5-4a23-b9b8-8d1586023e33 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.212265 Jun 22 08:58:55.024881 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 63/124] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:54 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:55.025714 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-dce0ef90-d2f1-4465-b346-c3719d905327 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:55.032506 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dce0ef90-d2f1-4465-b346-c3719d905327 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:55.033182 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dce0ef90-d2f1-4465-b346-c3719d905327 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:55.038656 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dce0ef90-d2f1-4465-b346-c3719d905327 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:55.038656 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dce0ef90-d2f1-4465-b346-c3719d905327 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:55.212459 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-dce0ef90-d2f1-4465-b346-c3719d905327 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:55.221643 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-dce0ef90-d2f1-4465-b346-c3719d905327 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.208143 Jun 22 08:58:55.233992 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 62/125] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:55 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:58:55.238934 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-83476d1a-1ba7-4622-9ae6-d60b19d0d943 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:55.239820 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-83476d1a-1ba7-4622-9ae6-d60b19d0d943 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:55.246435 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-83476d1a-1ba7-4622-9ae6-d60b19d0d943 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:55.246916 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-83476d1a-1ba7-4622-9ae6-d60b19d0d943 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:55.247669 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-83476d1a-1ba7-4622-9ae6-d60b19d0d943 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:55.248127 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-83476d1a-1ba7-4622-9ae6-d60b19d0d943 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:55.377771 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-83476d1a-1ba7-4622-9ae6-d60b19d0d943 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:55.386098 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-83476d1a-1ba7-4622-9ae6-d60b19d0d943 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.150776 Jun 22 08:58:55.396615 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 63/126] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:55 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:55.401666 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-be3ceb6d-c626-46d1-b2ea-d464dc9999cc tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:55.403604 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-be3ceb6d-c626-46d1-b2ea-d464dc9999cc tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:55.413567 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-be3ceb6d-c626-46d1-b2ea-d464dc9999cc tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:55.414217 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-be3ceb6d-c626-46d1-b2ea-d464dc9999cc tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:55.415202 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-be3ceb6d-c626-46d1-b2ea-d464dc9999cc tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:55.415953 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-be3ceb6d-c626-46d1-b2ea-d464dc9999cc tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:55.540865 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-522f2fdd-e96a-4b97-bc36-2419c5e03e8c req-1be2c4d8-af8f-44a5-b25f-b06c9a44146f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "713f284f-527e-4246-a442-f2d8a32428d5", "name": "network-vif-plugged", "status": "completed", "tag": "a3826696-5f1e-4efc-8516-fc2d14d29e17"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:58:55.550046 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-522f2fdd-e96a-4b97-bc36-2419c5e03e8c req-1be2c4d8-af8f-44a5-b25f-b06c9a44146f service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:55.551551 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-522f2fdd-e96a-4b97-bc36-2419c5e03e8c req-1be2c4d8-af8f-44a5-b25f-b06c9a44146f service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:55.565466 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-522f2fdd-e96a-4b97-bc36-2419c5e03e8c req-1be2c4d8-af8f-44a5-b25f-b06c9a44146f service nova] Creating event network-vif-plugged:a3826696-5f1e-4efc-8516-fc2d14d29e17 for instance 713f284f-527e-4246-a442-f2d8a32428d5 on hv-cinder-84599 Jun 22 08:58:55.572258 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-522f2fdd-e96a-4b97-bc36-2419c5e03e8c req-1be2c4d8-af8f-44a5-b25f-b06c9a44146f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.371755 Jun 22 08:58:55.573218 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 64/127] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 08:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 08:58:55.580829 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f0fc1a6e-439b-4db7-a716-340ca502a2a8 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:55.581732 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-f0fc1a6e-439b-4db7-a716-340ca502a2a8 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:55.588134 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f0fc1a6e-439b-4db7-a716-340ca502a2a8 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:55.588580 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f0fc1a6e-439b-4db7-a716-340ca502a2a8 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:55.589519 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f0fc1a6e-439b-4db7-a716-340ca502a2a8 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:55.590109 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f0fc1a6e-439b-4db7-a716-340ca502a2a8 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:55.595245 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-be3ceb6d-c626-46d1-b2ea-d464dc9999cc tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:55.603927 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-be3ceb6d-c626-46d1-b2ea-d464dc9999cc tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:55.605491 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-be3ceb6d-c626-46d1-b2ea-d464dc9999cc tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:55.606611 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-be3ceb6d-c626-46d1-b2ea-d464dc9999cc tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.208952 Jun 22 08:58:55.607184 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 64/128] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:58:55 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:58:55.729027 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-f0fc1a6e-439b-4db7-a716-340ca502a2a8 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:55.736563 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f0fc1a6e-439b-4db7-a716-340ca502a2a8 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1314 microversion: 2.1 time: 0.161951 Jun 22 08:58:55.737243 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 65/129] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:55 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:56.036040 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f75bb3c5-82d0-409e-9658-26b3073e268b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:56.036740 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f75bb3c5-82d0-409e-9658-26b3073e268b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:56.052476 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f75bb3c5-82d0-409e-9658-26b3073e268b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:56.053163 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f75bb3c5-82d0-409e-9658-26b3073e268b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:56.054503 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f75bb3c5-82d0-409e-9658-26b3073e268b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:56.055094 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f75bb3c5-82d0-409e-9658-26b3073e268b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:56.241333 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-85efb195-f76b-45c2-aa87-9937ac5a0dee tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:56.242926 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-85efb195-f76b-45c2-aa87-9937ac5a0dee tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:56.251821 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-85efb195-f76b-45c2-aa87-9937ac5a0dee tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:56.252525 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-85efb195-f76b-45c2-aa87-9937ac5a0dee tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:56.253706 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-85efb195-f76b-45c2-aa87-9937ac5a0dee tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:56.254323 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-85efb195-f76b-45c2-aa87-9937ac5a0dee tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:56.298554 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-f75bb3c5-82d0-409e-9658-26b3073e268b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:56.317381 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f75bb3c5-82d0-409e-9658-26b3073e268b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.285081 Jun 22 08:58:56.318147 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 65/130] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:56 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:56.409803 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-37b6520d-3ef6-4639-96f0-dd236aed1955 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:56.411220 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-37b6520d-3ef6-4639-96f0-dd236aed1955 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:56.419809 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-37b6520d-3ef6-4639-96f0-dd236aed1955 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:56.420260 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-37b6520d-3ef6-4639-96f0-dd236aed1955 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:56.422939 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-37b6520d-3ef6-4639-96f0-dd236aed1955 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:56.423766 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-37b6520d-3ef6-4639-96f0-dd236aed1955 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:56.461406 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-85efb195-f76b-45c2-aa87-9937ac5a0dee tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:56.474758 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-85efb195-f76b-45c2-aa87-9937ac5a0dee tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.238631 Jun 22 08:58:56.475566 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 66/131] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:56 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:56.610196 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-37b6520d-3ef6-4639-96f0-dd236aed1955 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:56.627899 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-db8a3b38-1e43-496f-b599-b55da1ddfa21 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:56.628802 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-db8a3b38-1e43-496f-b599-b55da1ddfa21 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:56.629090 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-37b6520d-3ef6-4639-96f0-dd236aed1955 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.224182 Jun 22 08:58:56.635361 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-db8a3b38-1e43-496f-b599-b55da1ddfa21 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:56.637537 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-db8a3b38-1e43-496f-b599-b55da1ddfa21 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:56.638378 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-db8a3b38-1e43-496f-b599-b55da1ddfa21 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:56.639013 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-db8a3b38-1e43-496f-b599-b55da1ddfa21 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:56.642413 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 66/132] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:56 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:58:56.754918 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-84c63bc4-b14b-4621-853d-8da6bdf69f5e tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:56.760690 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-84c63bc4-b14b-4621-853d-8da6bdf69f5e tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:56.762595 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-84c63bc4-b14b-4621-853d-8da6bdf69f5e tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:56.763044 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-84c63bc4-b14b-4621-853d-8da6bdf69f5e tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:56.763808 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-84c63bc4-b14b-4621-853d-8da6bdf69f5e tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:56.764407 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-84c63bc4-b14b-4621-853d-8da6bdf69f5e tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:56.851396 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-db8a3b38-1e43-496f-b599-b55da1ddfa21 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:56.873280 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-db8a3b38-1e43-496f-b599-b55da1ddfa21 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:56.878185 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-db8a3b38-1e43-496f-b599-b55da1ddfa21 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:56.882010 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-db8a3b38-1e43-496f-b599-b55da1ddfa21 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.259304 Jun 22 08:58:56.882890 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 67/133] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:58:56 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:58:56.927867 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-84c63bc4-b14b-4621-853d-8da6bdf69f5e tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:56.935309 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-84c63bc4-b14b-4621-853d-8da6bdf69f5e tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1314 microversion: 2.1 time: 0.184465 Jun 22 08:58:56.935902 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 67/134] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:56 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:57.334635 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-ee0d430d-7390-4be1-81e1-d3affc4ab999 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:57.335760 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-ee0d430d-7390-4be1-81e1-d3affc4ab999 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:57.342831 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ee0d430d-7390-4be1-81e1-d3affc4ab999 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:57.343526 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ee0d430d-7390-4be1-81e1-d3affc4ab999 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:57.344462 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ee0d430d-7390-4be1-81e1-d3affc4ab999 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:57.344958 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ee0d430d-7390-4be1-81e1-d3affc4ab999 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:57.492047 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-e566a7e4-b179-4131-bb7c-74d6b398af19 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:57.492682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-e566a7e4-b179-4131-bb7c-74d6b398af19 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:57.502827 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e566a7e4-b179-4131-bb7c-74d6b398af19 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:57.503781 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e566a7e4-b179-4131-bb7c-74d6b398af19 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:57.505037 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e566a7e4-b179-4131-bb7c-74d6b398af19 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:57.506279 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e566a7e4-b179-4131-bb7c-74d6b398af19 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:57.769849 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-ee0d430d-7390-4be1-81e1-d3affc4ab999 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:57.782327 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-ee0d430d-7390-4be1-81e1-d3affc4ab999 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.451233 Jun 22 08:58:57.783180 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 68/135] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:57 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:57.788632 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-d13d0892-8a1c-486d-b4fa-7c0ef2b86808 req-84109cc6-ee05-45be-9c8f-fd2a4e6011c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10", "tag": "9678ec97-a7d2-4f9c-aa09-000750551309"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:58:57.798682 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-d13d0892-8a1c-486d-b4fa-7c0ef2b86808 req-84109cc6-ee05-45be-9c8f-fd2a4e6011c1 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:57.799198 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-d13d0892-8a1c-486d-b4fa-7c0ef2b86808 req-84109cc6-ee05-45be-9c8f-fd2a4e6011c1 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:57.803429 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=100 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:58:57.812998 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-d13d0892-8a1c-486d-b4fa-7c0ef2b86808 req-84109cc6-ee05-45be-9c8f-fd2a4e6011c1 service nova] Creating event network-changed:9678ec97-a7d2-4f9c-aa09-000750551309 for instance cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 on hv-cinder-84599 Jun 22 08:58:57.820036 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-d13d0892-8a1c-486d-b4fa-7c0ef2b86808 req-84109cc6-ee05-45be-9c8f-fd2a4e6011c1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035473 Jun 22 08:58:57.823908 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 69/136] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 08:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:58:57.841760 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-39688c30-3512-4f85-993e-b4759616e80d req-176d3f45-3a4c-4469-8c6d-b8d2ada6f0f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eefd03e-9e6e-4710-b228-b87c5ddf475f", "name": "network-vif-plugged", "status": "completed", "tag": "7e660c9a-428c-40ae-95a2-99c74d79d984"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:58:57.852212 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-39688c30-3512-4f85-993e-b4759616e80d req-176d3f45-3a4c-4469-8c6d-b8d2ada6f0f9 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:57.852923 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-39688c30-3512-4f85-993e-b4759616e80d req-176d3f45-3a4c-4469-8c6d-b8d2ada6f0f9 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:57.866618 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-39688c30-3512-4f85-993e-b4759616e80d req-176d3f45-3a4c-4469-8c6d-b8d2ada6f0f9 service nova] Creating event network-vif-plugged:7e660c9a-428c-40ae-95a2-99c74d79d984 for instance 8eefd03e-9e6e-4710-b228-b87c5ddf475f on hv-cinder-84599 Jun 22 08:58:57.871998 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-39688c30-3512-4f85-993e-b4759616e80d req-176d3f45-3a4c-4469-8c6d-b8d2ada6f0f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045453 Jun 22 08:58:57.872929 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 70/137] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 08:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:58:57.880036 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-18e356a3-cc82-4cca-9182-c342602db922 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:57.881095 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-18e356a3-cc82-4cca-9182-c342602db922 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:57.890340 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-e566a7e4-b179-4131-bb7c-74d6b398af19 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:57.891559 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-18e356a3-cc82-4cca-9182-c342602db922 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:57.901067 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-18e356a3-cc82-4cca-9182-c342602db922 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:57.901067 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-18e356a3-cc82-4cca-9182-c342602db922 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:57.901067 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-18e356a3-cc82-4cca-9182-c342602db922 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:57.901496 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-e566a7e4-b179-4131-bb7c-74d6b398af19 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.411095 Jun 22 08:58:57.909475 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 68/138] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:57 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:57.915088 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-0edb8b82-39eb-401a-81d5-b2931aa8e0fc tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:57.915699 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-0edb8b82-39eb-401a-81d5-b2931aa8e0fc tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:57.922269 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0edb8b82-39eb-401a-81d5-b2931aa8e0fc tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:57.922719 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0edb8b82-39eb-401a-81d5-b2931aa8e0fc tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:57.923600 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0edb8b82-39eb-401a-81d5-b2931aa8e0fc tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:57.924090 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0edb8b82-39eb-401a-81d5-b2931aa8e0fc tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:58.115841 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-18e356a3-cc82-4cca-9182-c342602db922 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:58.119925 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-0edb8b82-39eb-401a-81d5-b2931aa8e0fc tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:58.123253 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-18e356a3-cc82-4cca-9182-c342602db922 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.248625 Jun 22 08:58:58.124412 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 71/139] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:57 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:58.128761 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-0edb8b82-39eb-401a-81d5-b2931aa8e0fc tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:58.128932 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-5ff038f5-b7c2-4629-8663-87770995a73e tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:58.129489 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-5ff038f5-b7c2-4629-8663-87770995a73e tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:58.130717 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-0edb8b82-39eb-401a-81d5-b2931aa8e0fc tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:58.132281 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-0edb8b82-39eb-401a-81d5-b2931aa8e0fc tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.221599 Jun 22 08:58:58.132398 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:58:58.132489 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 69/140] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:58:57 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:58:58.135754 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5ff038f5-b7c2-4629-8663-87770995a73e tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:58.136196 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5ff038f5-b7c2-4629-8663-87770995a73e tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:58.137000 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5ff038f5-b7c2-4629-8663-87770995a73e tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:58.137441 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5ff038f5-b7c2-4629-8663-87770995a73e tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:58.272551 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-5ff038f5-b7c2-4629-8663-87770995a73e tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:58.280734 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-5ff038f5-b7c2-4629-8663-87770995a73e tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1314 microversion: 2.1 time: 0.155300 Jun 22 08:58:58.281325 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 72/141] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:58 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:58.800160 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ae513b28-5ac2-40bf-8a71-629ad78c5871 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:58.801402 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ae513b28-5ac2-40bf-8a71-629ad78c5871 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:58.807449 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ae513b28-5ac2-40bf-8a71-629ad78c5871 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:58.807895 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ae513b28-5ac2-40bf-8a71-629ad78c5871 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:58.808655 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ae513b28-5ac2-40bf-8a71-629ad78c5871 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:58.809471 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ae513b28-5ac2-40bf-8a71-629ad78c5871 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:58.825241 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=100 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:58:58.919010 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-267be668-46c8-4f91-86dc-6a942813db2d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:58.921423 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-267be668-46c8-4f91-86dc-6a942813db2d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:58.938519 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-267be668-46c8-4f91-86dc-6a942813db2d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:58.940354 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-267be668-46c8-4f91-86dc-6a942813db2d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:58.940477 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-267be668-46c8-4f91-86dc-6a942813db2d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:58.940907 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-267be668-46c8-4f91-86dc-6a942813db2d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:59.089220 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ae513b28-5ac2-40bf-8a71-629ad78c5871 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:59.098686 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ae513b28-5ac2-40bf-8a71-629ad78c5871 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.303034 Jun 22 08:58:59.099864 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 70/142] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:58 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:59.143546 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-726bd214-6178-4128-a09c-8bc9feefaeaa tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:59.145337 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-726bd214-6178-4128-a09c-8bc9feefaeaa tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:59.155876 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-726bd214-6178-4128-a09c-8bc9feefaeaa tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:59.156679 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-726bd214-6178-4128-a09c-8bc9feefaeaa tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:59.158126 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-726bd214-6178-4128-a09c-8bc9feefaeaa tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:59.158893 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-726bd214-6178-4128-a09c-8bc9feefaeaa tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:59.171603 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-267be668-46c8-4f91-86dc-6a942813db2d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:59.187724 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-267be668-46c8-4f91-86dc-6a942813db2d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.273812 Jun 22 08:58:59.200508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 73/143] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:58 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:59.213357 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-00133f7b-60b4-431d-80d1-4ec1b9db9ba2 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:59.216856 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-00133f7b-60b4-431d-80d1-4ec1b9db9ba2 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:59.224064 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-00133f7b-60b4-431d-80d1-4ec1b9db9ba2 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:59.224660 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-00133f7b-60b4-431d-80d1-4ec1b9db9ba2 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:59.225469 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-00133f7b-60b4-431d-80d1-4ec1b9db9ba2 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:59.226079 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-00133f7b-60b4-431d-80d1-4ec1b9db9ba2 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:59.489327 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-726bd214-6178-4128-a09c-8bc9feefaeaa tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:59.496904 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-726bd214-6178-4128-a09c-8bc9feefaeaa tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.360056 Jun 22 08:58:59.499556 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 71/144] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:59 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:59.508821 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-4f43b186-e18f-428d-bdb1-cb79d32397e7 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:59.510248 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-4f43b186-e18f-428d-bdb1-cb79d32397e7 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:58:59.513164 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=100 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:58:59.526189 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4f43b186-e18f-428d-bdb1-cb79d32397e7 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:59.527094 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4f43b186-e18f-428d-bdb1-cb79d32397e7 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:59.528263 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4f43b186-e18f-428d-bdb1-cb79d32397e7 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:59.528979 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4f43b186-e18f-428d-bdb1-cb79d32397e7 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:59.529592 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-00133f7b-60b4-431d-80d1-4ec1b9db9ba2 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:59.541316 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-00133f7b-60b4-431d-80d1-4ec1b9db9ba2 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:59.543048 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-00133f7b-60b4-431d-80d1-4ec1b9db9ba2 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:59.545060 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-00133f7b-60b4-431d-80d1-4ec1b9db9ba2 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.341524 Jun 22 08:58:59.551159 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 74/145] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:58:59 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:58:59.674853 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-4f43b186-e18f-428d-bdb1-cb79d32397e7 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:58:59.682842 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-4f43b186-e18f-428d-bdb1-cb79d32397e7 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1314 microversion: 2.1 time: 0.178199 Jun 22 08:58:59.683417 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 72/146] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:58:59 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:59.839049 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-9948be45-8124-4eca-8373-d3163c81d603 req-77ea51c6-f4c1-4ef9-8f48-71644266fc49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dce83571-cd21-48a3-b54d-b6218f563363", "tag": "9ecba298-5328-4f62-bebc-dac62013eb8f"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:58:59.848577 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-9948be45-8124-4eca-8373-d3163c81d603 req-77ea51c6-f4c1-4ef9-8f48-71644266fc49 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:59.850323 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-9948be45-8124-4eca-8373-d3163c81d603 req-77ea51c6-f4c1-4ef9-8f48-71644266fc49 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:59.865608 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-9948be45-8124-4eca-8373-d3163c81d603 req-77ea51c6-f4c1-4ef9-8f48-71644266fc49 service nova] Creating event network-changed:9ecba298-5328-4f62-bebc-dac62013eb8f for instance dce83571-cd21-48a3-b54d-b6218f563363 on hv-cinder-84599 Jun 22 08:58:59.871338 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-9948be45-8124-4eca-8373-d3163c81d603 req-77ea51c6-f4c1-4ef9-8f48-71644266fc49 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036051 Jun 22 08:58:59.872193 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 75/147] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 08:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:59:00.115628 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-61b30bfa-f69d-4783-8f66-9fe8c1995280 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:00.116889 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-61b30bfa-f69d-4783-8f66-9fe8c1995280 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:00.123057 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-61b30bfa-f69d-4783-8f66-9fe8c1995280 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:00.124364 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-61b30bfa-f69d-4783-8f66-9fe8c1995280 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:00.125531 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-61b30bfa-f69d-4783-8f66-9fe8c1995280 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:00.125969 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-61b30bfa-f69d-4783-8f66-9fe8c1995280 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:00.206669 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-8b629912-bdea-4c2d-813a-07faab9cd60d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:00.207955 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-8b629912-bdea-4c2d-813a-07faab9cd60d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:00.217872 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8b629912-bdea-4c2d-813a-07faab9cd60d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:00.218720 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8b629912-bdea-4c2d-813a-07faab9cd60d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:00.219517 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8b629912-bdea-4c2d-813a-07faab9cd60d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:00.220506 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8b629912-bdea-4c2d-813a-07faab9cd60d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:00.258655 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-61b30bfa-f69d-4783-8f66-9fe8c1995280 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:00.266938 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-61b30bfa-f69d-4783-8f66-9fe8c1995280 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.155270 Jun 22 08:59:00.267650 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 73/148] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:00 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:00.359436 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-8b629912-bdea-4c2d-813a-07faab9cd60d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:00.367051 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-8b629912-bdea-4c2d-813a-07faab9cd60d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.165683 Jun 22 08:59:00.367609 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 76/149] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:00 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:00.515762 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ed6760b7-12e5-4f39-a307-6004f957d50c tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:00.516413 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ed6760b7-12e5-4f39-a307-6004f957d50c tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:00.525991 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ed6760b7-12e5-4f39-a307-6004f957d50c tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:00.526442 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ed6760b7-12e5-4f39-a307-6004f957d50c tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:00.527212 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ed6760b7-12e5-4f39-a307-6004f957d50c tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:00.527681 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ed6760b7-12e5-4f39-a307-6004f957d50c tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:00.566798 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-ef4bd7ec-8d9d-458f-92f6-76c31636bc10 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:00.567683 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-ef4bd7ec-8d9d-458f-92f6-76c31636bc10 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:00.575254 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ef4bd7ec-8d9d-458f-92f6-76c31636bc10 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:00.576232 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ef4bd7ec-8d9d-458f-92f6-76c31636bc10 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:00.577448 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ef4bd7ec-8d9d-458f-92f6-76c31636bc10 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:00.578110 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ef4bd7ec-8d9d-458f-92f6-76c31636bc10 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:00.735120 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ed6760b7-12e5-4f39-a307-6004f957d50c tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:00.743232 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ed6760b7-12e5-4f39-a307-6004f957d50c tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.232496 Jun 22 08:59:00.744132 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 74/150] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:00 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:00.757764 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-cb9a7b26-cfa8-414e-980c-4c54eafad119 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:00.757764 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-cb9a7b26-cfa8-414e-980c-4c54eafad119 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:00.763743 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-ef4bd7ec-8d9d-458f-92f6-76c31636bc10 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:00.768519 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cb9a7b26-cfa8-414e-980c-4c54eafad119 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:00.769199 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cb9a7b26-cfa8-414e-980c-4c54eafad119 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:00.770334 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cb9a7b26-cfa8-414e-980c-4c54eafad119 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:00.770966 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cb9a7b26-cfa8-414e-980c-4c54eafad119 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:00.772441 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-ef4bd7ec-8d9d-458f-92f6-76c31636bc10 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:00.774135 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-ef4bd7ec-8d9d-458f-92f6-76c31636bc10 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:00.775253 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-ef4bd7ec-8d9d-458f-92f6-76c31636bc10 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.214415 Jun 22 08:59:00.775810 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 77/151] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:00 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:59:00.929087 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-6fa8ebfd-012a-484d-9e86-cff8ed2d6a6c req-5bd9d26c-76e2-41b1-8622-c1972484f783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "699207bb-360b-451e-85ee-a5cc21227d44", "name": "network-vif-plugged", "status": "completed", "tag": "795afac5-e2d6-479f-b9e5-8f401a2994c0"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:59:00.941048 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-cb9a7b26-cfa8-414e-980c-4c54eafad119 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:00.946426 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-6fa8ebfd-012a-484d-9e86-cff8ed2d6a6c req-5bd9d26c-76e2-41b1-8622-c1972484f783 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:00.946876 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-6fa8ebfd-012a-484d-9e86-cff8ed2d6a6c req-5bd9d26c-76e2-41b1-8622-c1972484f783 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:00.961063 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-cb9a7b26-cfa8-414e-980c-4c54eafad119 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1314 microversion: 2.1 time: 0.211270 Jun 22 08:59:00.966570 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 75/152] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:00 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:00.969443 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-6fa8ebfd-012a-484d-9e86-cff8ed2d6a6c req-5bd9d26c-76e2-41b1-8622-c1972484f783 service nova] Creating event network-vif-plugged:795afac5-e2d6-479f-b9e5-8f401a2994c0 for instance 699207bb-360b-451e-85ee-a5cc21227d44 on hv-cinder-84599 Jun 22 08:59:00.974564 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-6fa8ebfd-012a-484d-9e86-cff8ed2d6a6c req-5bd9d26c-76e2-41b1-8622-c1972484f783 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052990 Jun 22 08:59:00.975215 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 78/153] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 08:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:59:01.283615 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1e22a97f-5a4d-4fd3-96c7-6fa6c9c25f62 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:01.284224 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1e22a97f-5a4d-4fd3-96c7-6fa6c9c25f62 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:01.290503 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1e22a97f-5a4d-4fd3-96c7-6fa6c9c25f62 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:01.290945 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1e22a97f-5a4d-4fd3-96c7-6fa6c9c25f62 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:01.291708 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1e22a97f-5a4d-4fd3-96c7-6fa6c9c25f62 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:01.292145 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1e22a97f-5a4d-4fd3-96c7-6fa6c9c25f62 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:01.385284 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f7c311ca-4094-46eb-aed1-b7c46e96ef87 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:01.386170 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-f7c311ca-4094-46eb-aed1-b7c46e96ef87 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:01.397888 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f7c311ca-4094-46eb-aed1-b7c46e96ef87 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:01.398673 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f7c311ca-4094-46eb-aed1-b7c46e96ef87 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:01.408194 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f7c311ca-4094-46eb-aed1-b7c46e96ef87 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:01.408194 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f7c311ca-4094-46eb-aed1-b7c46e96ef87 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:01.459936 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-1e22a97f-5a4d-4fd3-96c7-6fa6c9c25f62 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:01.468361 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1e22a97f-5a4d-4fd3-96c7-6fa6c9c25f62 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.188777 Jun 22 08:59:01.469286 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 76/154] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:01 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:01.585182 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-f7c311ca-4094-46eb-aed1-b7c46e96ef87 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:01.593805 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f7c311ca-4094-46eb-aed1-b7c46e96ef87 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.212812 Jun 22 08:59:01.594423 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 79/155] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:01 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:01.759995 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-2830df8b-6adf-4548-aae2-5d2af10c081e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:01.760624 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-2830df8b-6adf-4548-aae2-5d2af10c081e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:01.769271 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2830df8b-6adf-4548-aae2-5d2af10c081e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:01.769944 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2830df8b-6adf-4548-aae2-5d2af10c081e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:01.770988 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2830df8b-6adf-4548-aae2-5d2af10c081e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:01.771880 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2830df8b-6adf-4548-aae2-5d2af10c081e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:01.806373 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-fa597044-1f90-421a-b7f4-64d48d627cf0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:01.807617 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-fa597044-1f90-421a-b7f4-64d48d627cf0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:01.827278 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fa597044-1f90-421a-b7f4-64d48d627cf0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:01.827845 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fa597044-1f90-421a-b7f4-64d48d627cf0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:01.828804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fa597044-1f90-421a-b7f4-64d48d627cf0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:01.829334 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fa597044-1f90-421a-b7f4-64d48d627cf0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:01.968429 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-2830df8b-6adf-4548-aae2-5d2af10c081e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:01.975973 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-2830df8b-6adf-4548-aae2-5d2af10c081e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.219787 Jun 22 08:59:01.976531 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 77/156] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:01 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:01.981359 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-e6c374e2-59c9-432d-a1c1-b48cf586aea9 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:01.981506 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-e6c374e2-59c9-432d-a1c1-b48cf586aea9 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:01.987983 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e6c374e2-59c9-432d-a1c1-b48cf586aea9 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:01.988427 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e6c374e2-59c9-432d-a1c1-b48cf586aea9 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:01.989245 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e6c374e2-59c9-432d-a1c1-b48cf586aea9 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:01.989676 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e6c374e2-59c9-432d-a1c1-b48cf586aea9 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:02.002993 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-fa597044-1f90-421a-b7f4-64d48d627cf0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:02.011295 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-fa597044-1f90-421a-b7f4-64d48d627cf0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:02.013050 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-fa597044-1f90-421a-b7f4-64d48d627cf0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:02.015438 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-fa597044-1f90-421a-b7f4-64d48d627cf0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.223956 Jun 22 08:59:02.016188 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 80/157] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:01 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:59:02.125890 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-e6c374e2-59c9-432d-a1c1-b48cf586aea9 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:02.133435 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-e6c374e2-59c9-432d-a1c1-b48cf586aea9 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1501 microversion: 2.1 time: 0.155950 Jun 22 08:59:02.134018 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 78/158] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:01 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1501 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:02.485875 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-6fd12771-dfcc-4d7f-ba18-9d3f5b005634 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:02.486483 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-6fd12771-dfcc-4d7f-ba18-9d3f5b005634 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:02.492477 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6fd12771-dfcc-4d7f-ba18-9d3f5b005634 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:02.493043 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6fd12771-dfcc-4d7f-ba18-9d3f5b005634 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:02.493817 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6fd12771-dfcc-4d7f-ba18-9d3f5b005634 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:02.494266 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6fd12771-dfcc-4d7f-ba18-9d3f5b005634 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:02.612340 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-191af505-286f-4096-bd41-68b628c1d28d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:02.613134 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-191af505-286f-4096-bd41-68b628c1d28d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:02.619304 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-191af505-286f-4096-bd41-68b628c1d28d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:02.619824 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-191af505-286f-4096-bd41-68b628c1d28d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:02.620657 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-191af505-286f-4096-bd41-68b628c1d28d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:02.621191 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-191af505-286f-4096-bd41-68b628c1d28d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:02.629530 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-6fd12771-dfcc-4d7f-ba18-9d3f5b005634 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:02.637102 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-6fd12771-dfcc-4d7f-ba18-9d3f5b005634 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.156195 Jun 22 08:59:02.637672 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 81/159] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:02 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:02.751090 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-191af505-286f-4096-bd41-68b628c1d28d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:02.758406 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-191af505-286f-4096-bd41-68b628c1d28d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.150723 Jun 22 08:59:02.759051 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 79/160] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:02 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:02.993280 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-391ad495-b9d2-4802-8237-fbfcc055b759 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:02.993892 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-391ad495-b9d2-4802-8237-fbfcc055b759 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:03.000157 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-391ad495-b9d2-4802-8237-fbfcc055b759 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:03.000612 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-391ad495-b9d2-4802-8237-fbfcc055b759 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:03.001419 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-391ad495-b9d2-4802-8237-fbfcc055b759 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:03.001860 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-391ad495-b9d2-4802-8237-fbfcc055b759 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:03.033615 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-40e829cd-822f-4872-a482-2416eb940c63 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:03.034231 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-40e829cd-822f-4872-a482-2416eb940c63 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:03.040323 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-40e829cd-822f-4872-a482-2416eb940c63 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:03.040797 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-40e829cd-822f-4872-a482-2416eb940c63 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:03.041629 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-40e829cd-822f-4872-a482-2416eb940c63 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:03.042071 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-40e829cd-822f-4872-a482-2416eb940c63 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:03.191211 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-391ad495-b9d2-4802-8237-fbfcc055b759 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:03.203118 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-391ad495-b9d2-4802-8237-fbfcc055b759 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.213642 Jun 22 08:59:03.203788 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 82/161] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:02 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:03.218380 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-40e829cd-822f-4872-a482-2416eb940c63 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:03.226345 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-40e829cd-822f-4872-a482-2416eb940c63 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:03.227846 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-40e829cd-822f-4872-a482-2416eb940c63 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:03.229006 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-40e829cd-822f-4872-a482-2416eb940c63 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.199853 Jun 22 08:59:03.229567 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 80/162] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:03 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 08:59:03.654331 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-ee5f5aa0-40bd-4a2d-9498-8f1a9f2aafac tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:03.654840 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-ee5f5aa0-40bd-4a2d-9498-8f1a9f2aafac tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:03.661054 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ee5f5aa0-40bd-4a2d-9498-8f1a9f2aafac tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:03.661502 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ee5f5aa0-40bd-4a2d-9498-8f1a9f2aafac tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:03.662255 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ee5f5aa0-40bd-4a2d-9498-8f1a9f2aafac tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:03.662688 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ee5f5aa0-40bd-4a2d-9498-8f1a9f2aafac tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:03.775447 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-86b2c6e0-096e-4ae1-b1a2-1ad59d16a7b7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:03.776057 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-86b2c6e0-096e-4ae1-b1a2-1ad59d16a7b7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:03.782564 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-86b2c6e0-096e-4ae1-b1a2-1ad59d16a7b7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:03.783191 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-86b2c6e0-096e-4ae1-b1a2-1ad59d16a7b7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:03.783869 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-86b2c6e0-096e-4ae1-b1a2-1ad59d16a7b7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:03.784214 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-86b2c6e0-096e-4ae1-b1a2-1ad59d16a7b7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:03.791665 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-ee5f5aa0-40bd-4a2d-9498-8f1a9f2aafac tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:03.800002 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-ee5f5aa0-40bd-4a2d-9498-8f1a9f2aafac tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.149650 Jun 22 08:59:03.800586 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 83/163] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:03 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:03.919365 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-86b2c6e0-096e-4ae1-b1a2-1ad59d16a7b7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:03.924150 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-86b2c6e0-096e-4ae1-b1a2-1ad59d16a7b7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.152603 Jun 22 08:59:03.924701 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 81/164] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:03 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:04.220320 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-6f2ee887-9201-4de3-8e5b-31c3ccc39c66 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:04.220969 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-6f2ee887-9201-4de3-8e5b-31c3ccc39c66 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:04.226998 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6f2ee887-9201-4de3-8e5b-31c3ccc39c66 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:04.227449 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6f2ee887-9201-4de3-8e5b-31c3ccc39c66 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:04.228204 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6f2ee887-9201-4de3-8e5b-31c3ccc39c66 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:04.228644 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6f2ee887-9201-4de3-8e5b-31c3ccc39c66 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:04.247157 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-369abd3b-2dda-4c78-bfe2-9c8625fdfc30 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:04.247871 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-369abd3b-2dda-4c78-bfe2-9c8625fdfc30 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:04.254196 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-369abd3b-2dda-4c78-bfe2-9c8625fdfc30 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:04.254650 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-369abd3b-2dda-4c78-bfe2-9c8625fdfc30 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:04.255415 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-369abd3b-2dda-4c78-bfe2-9c8625fdfc30 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:04.255856 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-369abd3b-2dda-4c78-bfe2-9c8625fdfc30 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:04.406565 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-6f2ee887-9201-4de3-8e5b-31c3ccc39c66 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:04.414149 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-6f2ee887-9201-4de3-8e5b-31c3ccc39c66 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.198553 Jun 22 08:59:04.414646 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 84/165] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:04 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:04.426917 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-369abd3b-2dda-4c78-bfe2-9c8625fdfc30 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:04.434934 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-369abd3b-2dda-4c78-bfe2-9c8625fdfc30 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:04.436701 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-369abd3b-2dda-4c78-bfe2-9c8625fdfc30 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:04.437849 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-369abd3b-2dda-4c78-bfe2-9c8625fdfc30 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.194676 Jun 22 08:59:04.438400 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 82/166] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:04 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 08:59:04.817649 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e754ed82-99a0-4228-9b80-e11d9dab514d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:04.818267 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e754ed82-99a0-4228-9b80-e11d9dab514d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:04.824196 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e754ed82-99a0-4228-9b80-e11d9dab514d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:04.824647 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e754ed82-99a0-4228-9b80-e11d9dab514d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:04.825442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e754ed82-99a0-4228-9b80-e11d9dab514d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:04.825884 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e754ed82-99a0-4228-9b80-e11d9dab514d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:04.941860 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-cdbe2192-7016-41ee-bb93-a0819ac3c5e9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:04.942465 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-cdbe2192-7016-41ee-bb93-a0819ac3c5e9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:04.948503 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cdbe2192-7016-41ee-bb93-a0819ac3c5e9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:04.948993 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cdbe2192-7016-41ee-bb93-a0819ac3c5e9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:04.949753 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cdbe2192-7016-41ee-bb93-a0819ac3c5e9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:04.950215 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cdbe2192-7016-41ee-bb93-a0819ac3c5e9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:04.959521 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-e754ed82-99a0-4228-9b80-e11d9dab514d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:04.965595 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e754ed82-99a0-4228-9b80-e11d9dab514d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.151788 Jun 22 08:59:04.966365 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 85/167] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:04 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:05.076264 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-cdbe2192-7016-41ee-bb93-a0819ac3c5e9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:05.084296 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-cdbe2192-7016-41ee-bb93-a0819ac3c5e9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.146230 Jun 22 08:59:05.084869 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 83/168] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:04 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:05.430872 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c9dd5c14-8ed1-4936-bf53-0ff7c0ea6153 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:05.431613 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c9dd5c14-8ed1-4936-bf53-0ff7c0ea6153 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:05.438717 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c9dd5c14-8ed1-4936-bf53-0ff7c0ea6153 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:05.439163 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c9dd5c14-8ed1-4936-bf53-0ff7c0ea6153 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:05.439915 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c9dd5c14-8ed1-4936-bf53-0ff7c0ea6153 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:05.440349 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c9dd5c14-8ed1-4936-bf53-0ff7c0ea6153 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:05.455413 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-5047f6ec-1c34-4d95-a241-8b2268cedd31 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:05.456023 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-5047f6ec-1c34-4d95-a241-8b2268cedd31 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:05.461951 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5047f6ec-1c34-4d95-a241-8b2268cedd31 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:05.462589 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5047f6ec-1c34-4d95-a241-8b2268cedd31 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:05.463131 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5047f6ec-1c34-4d95-a241-8b2268cedd31 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:05.463560 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5047f6ec-1c34-4d95-a241-8b2268cedd31 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:05.634216 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c9dd5c14-8ed1-4936-bf53-0ff7c0ea6153 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:05.641183 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-5047f6ec-1c34-4d95-a241-8b2268cedd31 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:05.641900 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c9dd5c14-8ed1-4936-bf53-0ff7c0ea6153 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.214984 Jun 22 08:59:05.642473 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 86/169] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:05 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:05.649219 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-5047f6ec-1c34-4d95-a241-8b2268cedd31 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:05.650667 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-5047f6ec-1c34-4d95-a241-8b2268cedd31 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:05.651798 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-5047f6ec-1c34-4d95-a241-8b2268cedd31 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.200376 Jun 22 08:59:05.652422 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 84/170] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:05 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 08:59:05.982698 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-19da337c-2220-46aa-9c78-dead53a6d9ec tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:05.983313 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-19da337c-2220-46aa-9c78-dead53a6d9ec tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:05.989495 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-19da337c-2220-46aa-9c78-dead53a6d9ec tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:05.989945 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-19da337c-2220-46aa-9c78-dead53a6d9ec tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:05.990716 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-19da337c-2220-46aa-9c78-dead53a6d9ec tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:05.991156 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-19da337c-2220-46aa-9c78-dead53a6d9ec tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:06.100139 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-e0552632-189c-4d92-a24f-5309f73adbb8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:06.101001 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-e0552632-189c-4d92-a24f-5309f73adbb8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:06.107031 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e0552632-189c-4d92-a24f-5309f73adbb8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:06.107539 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e0552632-189c-4d92-a24f-5309f73adbb8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:06.111508 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e0552632-189c-4d92-a24f-5309f73adbb8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:06.111508 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e0552632-189c-4d92-a24f-5309f73adbb8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:06.117465 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-19da337c-2220-46aa-9c78-dead53a6d9ec tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:06.125804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-19da337c-2220-46aa-9c78-dead53a6d9ec tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.147054 Jun 22 08:59:06.126492 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 87/171] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:05 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:06.239239 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-e0552632-189c-4d92-a24f-5309f73adbb8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:06.246978 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-e0552632-189c-4d92-a24f-5309f73adbb8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.150680 Jun 22 08:59:06.247730 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 85/172] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:06 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:06.658580 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-09c7de98-2b92-43c7-bf0b-26b5fcd8ca0f tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:06.659505 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-09c7de98-2b92-43c7-bf0b-26b5fcd8ca0f tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:06.670138 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-74663c67-1687-479d-95bd-95a8a996028f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:06.670745 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-74663c67-1687-479d-95bd-95a8a996028f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:06.673479 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-09c7de98-2b92-43c7-bf0b-26b5fcd8ca0f tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:06.673944 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-09c7de98-2b92-43c7-bf0b-26b5fcd8ca0f tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:06.674730 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-09c7de98-2b92-43c7-bf0b-26b5fcd8ca0f tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:06.675175 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-09c7de98-2b92-43c7-bf0b-26b5fcd8ca0f tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:06.677577 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-74663c67-1687-479d-95bd-95a8a996028f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:06.678023 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-74663c67-1687-479d-95bd-95a8a996028f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:06.678781 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-74663c67-1687-479d-95bd-95a8a996028f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:06.679450 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-74663c67-1687-479d-95bd-95a8a996028f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:06.703954 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=100 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:06.897903 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-09c7de98-2b92-43c7-bf0b-26b5fcd8ca0f tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:06.904178 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-74663c67-1687-479d-95bd-95a8a996028f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:06.909821 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-74663c67-1687-479d-95bd-95a8a996028f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:06.910502 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-09c7de98-2b92-43c7-bf0b-26b5fcd8ca0f tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.255573 Jun 22 08:59:06.912063 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 88/173] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:06 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:06.918217 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-74663c67-1687-479d-95bd-95a8a996028f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:06.919492 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-74663c67-1687-479d-95bd-95a8a996028f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.253262 Jun 22 08:59:06.920130 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 86/174] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:06 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:59:06.928962 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-1eb9580e-ee10-47a6-8389-53faa62badeb req-80babfbe-f028-410f-8f3d-0840ebc0765e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b84e6922-9b60-4a6d-8836-4b07ef206590", "name": "network-vif-plugged", "status": "completed", "tag": "e4f8b1de-c427-4428-a8a5-28fa99c60cba"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:59:06.939538 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-1eb9580e-ee10-47a6-8389-53faa62badeb req-80babfbe-f028-410f-8f3d-0840ebc0765e service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:06.940030 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-1eb9580e-ee10-47a6-8389-53faa62badeb req-80babfbe-f028-410f-8f3d-0840ebc0765e service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:06.951437 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-1eb9580e-ee10-47a6-8389-53faa62badeb req-80babfbe-f028-410f-8f3d-0840ebc0765e service nova] Creating event network-vif-plugged:e4f8b1de-c427-4428-a8a5-28fa99c60cba for instance b84e6922-9b60-4a6d-8836-4b07ef206590 on hv-cinder-84599 Jun 22 08:59:06.957549 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-1eb9580e-ee10-47a6-8389-53faa62badeb req-80babfbe-f028-410f-8f3d-0840ebc0765e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033113 Jun 22 08:59:06.957549 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 89/175] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 08:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:59:07.036805 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1642e903-5b6c-4bf1-8be3-df6bf9a8fc08 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6456dd34-d02c-4df9-abf8-b597e3ddefbd"}} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:59:07.037964 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1642e903-5b6c-4bf1-8be3-df6bf9a8fc08 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:07.043933 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1642e903-5b6c-4bf1-8be3-df6bf9a8fc08 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:07.044378 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1642e903-5b6c-4bf1-8be3-df6bf9a8fc08 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:07.045172 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1642e903-5b6c-4bf1-8be3-df6bf9a8fc08 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:07.045603 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1642e903-5b6c-4bf1-8be3-df6bf9a8fc08 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:07.048579 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=100 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:07.142740 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c7f545f9-5282-4c00-9458-c36aca5eb8a2 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:07.143445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c7f545f9-5282-4c00-9458-c36aca5eb8a2 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:07.150122 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c7f545f9-5282-4c00-9458-c36aca5eb8a2 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:07.150768 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c7f545f9-5282-4c00-9458-c36aca5eb8a2 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:07.151544 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c7f545f9-5282-4c00-9458-c36aca5eb8a2 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:07.151984 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c7f545f9-5282-4c00-9458-c36aca5eb8a2 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:07.283989 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c7f545f9-5282-4c00-9458-c36aca5eb8a2 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:07.291772 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c7f545f9-5282-4c00-9458-c36aca5eb8a2 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.153378 Jun 22 08:59:07.292390 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 90/176] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:07 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:07.297604 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e37e01e5-fe88-43f8-aa00-b3384a62fa5c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:07.298295 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e37e01e5-fe88-43f8-aa00-b3384a62fa5c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:07.304823 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e37e01e5-fe88-43f8-aa00-b3384a62fa5c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:07.305345 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e37e01e5-fe88-43f8-aa00-b3384a62fa5c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:07.306170 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e37e01e5-fe88-43f8-aa00-b3384a62fa5c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:07.317682 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e37e01e5-fe88-43f8-aa00-b3384a62fa5c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:07.450393 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-e37e01e5-fe88-43f8-aa00-b3384a62fa5c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:07.461468 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e37e01e5-fe88-43f8-aa00-b3384a62fa5c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.167953 Jun 22 08:59:07.462213 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 91/177] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:07 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:07.931009 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-0a5a2408-85e7-4c1d-8195-cf625d480feb tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:07.931009 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-0a5a2408-85e7-4c1d-8195-cf625d480feb tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:07.936430 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0a5a2408-85e7-4c1d-8195-cf625d480feb tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:07.937008 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0a5a2408-85e7-4c1d-8195-cf625d480feb tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:07.937961 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0a5a2408-85e7-4c1d-8195-cf625d480feb tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:07.938556 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0a5a2408-85e7-4c1d-8195-cf625d480feb tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:08.103363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-0a5a2408-85e7-4c1d-8195-cf625d480feb tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:08.111915 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-0a5a2408-85e7-4c1d-8195-cf625d480feb tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.186493 Jun 22 08:59:08.112814 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 92/178] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:07 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:08.117213 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c31a2fd4-0440-406d-a156-4b79854d97d0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:08.117823 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c31a2fd4-0440-406d-a156-4b79854d97d0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:08.123588 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c31a2fd4-0440-406d-a156-4b79854d97d0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:08.124078 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c31a2fd4-0440-406d-a156-4b79854d97d0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:08.125043 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c31a2fd4-0440-406d-a156-4b79854d97d0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:08.125487 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c31a2fd4-0440-406d-a156-4b79854d97d0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:08.295111 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c31a2fd4-0440-406d-a156-4b79854d97d0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:08.303735 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c31a2fd4-0440-406d-a156-4b79854d97d0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:08.305296 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c31a2fd4-0440-406d-a156-4b79854d97d0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:08.306496 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c31a2fd4-0440-406d-a156-4b79854d97d0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.192748 Jun 22 08:59:08.307140 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 93/179] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:08 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:59:08.312549 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-5983657e-ee63-4773-b53b-947a07410fdb tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:08.313262 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-5983657e-ee63-4773-b53b-947a07410fdb tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:08.319256 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5983657e-ee63-4773-b53b-947a07410fdb tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:08.319678 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5983657e-ee63-4773-b53b-947a07410fdb tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:08.320451 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5983657e-ee63-4773-b53b-947a07410fdb tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:08.320947 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5983657e-ee63-4773-b53b-947a07410fdb tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:08.489171 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-5983657e-ee63-4773-b53b-947a07410fdb tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:08.499064 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-5983657e-ee63-4773-b53b-947a07410fdb tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.190758 Jun 22 08:59:08.499945 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 94/180] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:08 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:08.505008 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-370be853-e146-4b1a-9837-dcb66f2b33b8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:08.505854 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-370be853-e146-4b1a-9837-dcb66f2b33b8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:08.517043 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-370be853-e146-4b1a-9837-dcb66f2b33b8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:08.517523 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-370be853-e146-4b1a-9837-dcb66f2b33b8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:08.518323 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-370be853-e146-4b1a-9837-dcb66f2b33b8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:08.519039 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-370be853-e146-4b1a-9837-dcb66f2b33b8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:08.653100 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-370be853-e146-4b1a-9837-dcb66f2b33b8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:08.662328 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-370be853-e146-4b1a-9837-dcb66f2b33b8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.161178 Jun 22 08:59:08.662890 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 95/181] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:08 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:09.129884 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-63e609bb-3dd4-4074-a8e7-ed947c8d3839 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:09.130420 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-63e609bb-3dd4-4074-a8e7-ed947c8d3839 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:09.136380 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-63e609bb-3dd4-4074-a8e7-ed947c8d3839 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:09.136848 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-63e609bb-3dd4-4074-a8e7-ed947c8d3839 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:09.137603 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-63e609bb-3dd4-4074-a8e7-ed947c8d3839 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:09.138031 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-63e609bb-3dd4-4074-a8e7-ed947c8d3839 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:09.272699 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-63e609bb-3dd4-4074-a8e7-ed947c8d3839 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:09.281196 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-63e609bb-3dd4-4074-a8e7-ed947c8d3839 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.154635 Jun 22 08:59:09.281857 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 96/182] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:09 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:09.325026 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-3a7dc4f9-704a-411f-add7-c37fbd963a37 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:09.325671 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-3a7dc4f9-704a-411f-add7-c37fbd963a37 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:09.332076 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3a7dc4f9-704a-411f-add7-c37fbd963a37 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:09.332499 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3a7dc4f9-704a-411f-add7-c37fbd963a37 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:09.333296 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3a7dc4f9-704a-411f-add7-c37fbd963a37 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:09.333751 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3a7dc4f9-704a-411f-add7-c37fbd963a37 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:09.468907 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-3a7dc4f9-704a-411f-add7-c37fbd963a37 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:09.476885 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-3a7dc4f9-704a-411f-add7-c37fbd963a37 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:09.478535 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-3a7dc4f9-704a-411f-add7-c37fbd963a37 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:09.479634 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-3a7dc4f9-704a-411f-add7-c37fbd963a37 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.158548 Jun 22 08:59:09.480185 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 97/183] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:09 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 08:59:09.515490 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e3a1549f-1f4b-4f56-910f-349df3410492 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:09.516217 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e3a1549f-1f4b-4f56-910f-349df3410492 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:09.522292 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e3a1549f-1f4b-4f56-910f-349df3410492 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:09.522740 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e3a1549f-1f4b-4f56-910f-349df3410492 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:09.523503 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e3a1549f-1f4b-4f56-910f-349df3410492 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:09.523955 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e3a1549f-1f4b-4f56-910f-349df3410492 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:09.677357 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-e3a1549f-1f4b-4f56-910f-349df3410492 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:09.684710 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e3a1549f-1f4b-4f56-910f-349df3410492 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.172863 Jun 22 08:59:09.685296 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 98/184] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:09 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:09.699688 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-5ac8444a-7c38-4ae4-981e-82ee6947ee76 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:09.700207 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-5ac8444a-7c38-4ae4-981e-82ee6947ee76 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:09.706407 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5ac8444a-7c38-4ae4-981e-82ee6947ee76 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:09.707039 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5ac8444a-7c38-4ae4-981e-82ee6947ee76 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:09.710854 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5ac8444a-7c38-4ae4-981e-82ee6947ee76 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:09.710854 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5ac8444a-7c38-4ae4-981e-82ee6947ee76 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:09.835237 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-5ac8444a-7c38-4ae4-981e-82ee6947ee76 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:09.845431 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-5ac8444a-7c38-4ae4-981e-82ee6947ee76 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.149467 Jun 22 08:59:09.846015 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 99/185] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:09 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:10.422593 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-0ed6b5db-bc19-4c5f-aa14-02d07800cae9 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:10.422593 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-0ed6b5db-bc19-4c5f-aa14-02d07800cae9 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:10.422593 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0ed6b5db-bc19-4c5f-aa14-02d07800cae9 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:10.422593 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0ed6b5db-bc19-4c5f-aa14-02d07800cae9 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:10.423801 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0ed6b5db-bc19-4c5f-aa14-02d07800cae9 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:10.423801 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0ed6b5db-bc19-4c5f-aa14-02d07800cae9 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:10.437955 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-0ed6b5db-bc19-4c5f-aa14-02d07800cae9 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:10.445479 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-0ed6b5db-bc19-4c5f-aa14-02d07800cae9 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.151368 Jun 22 08:59:10.447729 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 100/186] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:10 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:10.498250 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c655ef13-660c-47e7-9193-286b2daea3cb tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:10.498917 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c655ef13-660c-47e7-9193-286b2daea3cb tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:10.504870 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c655ef13-660c-47e7-9193-286b2daea3cb tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:10.506875 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c655ef13-660c-47e7-9193-286b2daea3cb tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:10.506875 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c655ef13-660c-47e7-9193-286b2daea3cb tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:10.506875 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c655ef13-660c-47e7-9193-286b2daea3cb tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:10.637046 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c655ef13-660c-47e7-9193-286b2daea3cb tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:10.645670 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c655ef13-660c-47e7-9193-286b2daea3cb tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:10.647159 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c655ef13-660c-47e7-9193-286b2daea3cb tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:10.648258 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c655ef13-660c-47e7-9193-286b2daea3cb tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.153882 Jun 22 08:59:10.648826 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 101/187] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:10 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 08:59:10.702649 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9f47dc65-7115-4770-9ae8-8d07af8886e3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:10.703259 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9f47dc65-7115-4770-9ae8-8d07af8886e3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:10.709226 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9f47dc65-7115-4770-9ae8-8d07af8886e3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:10.709672 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9f47dc65-7115-4770-9ae8-8d07af8886e3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:10.710421 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9f47dc65-7115-4770-9ae8-8d07af8886e3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:10.710865 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9f47dc65-7115-4770-9ae8-8d07af8886e3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:10.844603 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9f47dc65-7115-4770-9ae8-8d07af8886e3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:10.852567 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9f47dc65-7115-4770-9ae8-8d07af8886e3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.154138 Jun 22 08:59:10.853446 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 102/188] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:10 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:10.861919 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-fa89d2df-4357-47d9-933e-c6004276cd2f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:10.862525 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-fa89d2df-4357-47d9-933e-c6004276cd2f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:10.869154 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fa89d2df-4357-47d9-933e-c6004276cd2f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:10.869604 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fa89d2df-4357-47d9-933e-c6004276cd2f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:10.870371 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fa89d2df-4357-47d9-933e-c6004276cd2f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:10.870799 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fa89d2df-4357-47d9-933e-c6004276cd2f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:11.004718 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-fa89d2df-4357-47d9-933e-c6004276cd2f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:11.012160 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-fa89d2df-4357-47d9-933e-c6004276cd2f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.153939 Jun 22 08:59:11.012724 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 103/189] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:10 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:11.462586 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-4ea2e93d-cf89-48bb-bb09-39e2f0bce719 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:11.463430 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-4ea2e93d-cf89-48bb-bb09-39e2f0bce719 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:11.469700 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4ea2e93d-cf89-48bb-bb09-39e2f0bce719 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:11.470174 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4ea2e93d-cf89-48bb-bb09-39e2f0bce719 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:11.471109 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4ea2e93d-cf89-48bb-bb09-39e2f0bce719 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:11.471584 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4ea2e93d-cf89-48bb-bb09-39e2f0bce719 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:11.603234 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-4ea2e93d-cf89-48bb-bb09-39e2f0bce719 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:11.611663 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-4ea2e93d-cf89-48bb-bb09-39e2f0bce719 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.152908 Jun 22 08:59:11.612230 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 104/190] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:11 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:11.666764 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-fe241254-faa6-41e6-aa7f-c4175a2ddda5 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:11.667528 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-fe241254-faa6-41e6-aa7f-c4175a2ddda5 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:11.674371 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fe241254-faa6-41e6-aa7f-c4175a2ddda5 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:11.674826 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fe241254-faa6-41e6-aa7f-c4175a2ddda5 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:11.675592 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fe241254-faa6-41e6-aa7f-c4175a2ddda5 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:11.676037 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fe241254-faa6-41e6-aa7f-c4175a2ddda5 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:11.805938 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-fe241254-faa6-41e6-aa7f-c4175a2ddda5 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:11.809507 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=100 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:11.815100 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-fe241254-faa6-41e6-aa7f-c4175a2ddda5 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:11.816835 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-fe241254-faa6-41e6-aa7f-c4175a2ddda5 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:11.817989 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-fe241254-faa6-41e6-aa7f-c4175a2ddda5 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.155059 Jun 22 08:59:11.818596 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 105/191] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:11 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 08:59:11.869822 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2f83510b-ce33-4a67-a630-4db37aed842f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:11.870437 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2f83510b-ce33-4a67-a630-4db37aed842f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:11.877272 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2f83510b-ce33-4a67-a630-4db37aed842f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:11.877727 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2f83510b-ce33-4a67-a630-4db37aed842f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:11.878522 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2f83510b-ce33-4a67-a630-4db37aed842f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:11.878966 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2f83510b-ce33-4a67-a630-4db37aed842f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:12.035464 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-2f83510b-ce33-4a67-a630-4db37aed842f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:12.054289 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2f83510b-ce33-4a67-a630-4db37aed842f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.179014 Jun 22 08:59:12.054289 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 106/192] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:11 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:12.054289 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-1357a5a7-cfcd-4b1e-9e8c-59fc30f9b245 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:12.054289 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-1357a5a7-cfcd-4b1e-9e8c-59fc30f9b245 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:12.058016 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1357a5a7-cfcd-4b1e-9e8c-59fc30f9b245 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:12.058407 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1357a5a7-cfcd-4b1e-9e8c-59fc30f9b245 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:12.059180 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1357a5a7-cfcd-4b1e-9e8c-59fc30f9b245 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:12.059609 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1357a5a7-cfcd-4b1e-9e8c-59fc30f9b245 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:12.232019 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-1357a5a7-cfcd-4b1e-9e8c-59fc30f9b245 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:12.239883 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-1357a5a7-cfcd-4b1e-9e8c-59fc30f9b245 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.193407 Jun 22 08:59:12.240452 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 107/193] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:12 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:12.628137 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-095d651f-86d9-4b46-bbde-2cde2fb93725 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:12.633267 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-095d651f-86d9-4b46-bbde-2cde2fb93725 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:12.634895 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-095d651f-86d9-4b46-bbde-2cde2fb93725 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:12.635353 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-095d651f-86d9-4b46-bbde-2cde2fb93725 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:12.636115 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-095d651f-86d9-4b46-bbde-2cde2fb93725 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:12.636553 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-095d651f-86d9-4b46-bbde-2cde2fb93725 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:12.779214 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-095d651f-86d9-4b46-bbde-2cde2fb93725 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:12.786990 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-095d651f-86d9-4b46-bbde-2cde2fb93725 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.163407 Jun 22 08:59:12.787592 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 108/194] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:12 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:12.837572 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-5c033863-157e-4c86-8348-e028fc7a0256 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:12.838191 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-5c033863-157e-4c86-8348-e028fc7a0256 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:12.844578 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5c033863-157e-4c86-8348-e028fc7a0256 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:12.845041 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5c033863-157e-4c86-8348-e028fc7a0256 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:12.845958 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5c033863-157e-4c86-8348-e028fc7a0256 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:12.846442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5c033863-157e-4c86-8348-e028fc7a0256 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:12.987498 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-5c033863-157e-4c86-8348-e028fc7a0256 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:12.996351 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-5c033863-157e-4c86-8348-e028fc7a0256 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:12.998046 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-5c033863-157e-4c86-8348-e028fc7a0256 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:13.001151 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-5c033863-157e-4c86-8348-e028fc7a0256 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.167727 Jun 22 08:59:13.012183 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 109/195] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:12 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 08:59:13.062804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-4026b801-3315-4001-8f27-1126af2b90c3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:13.063456 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-4026b801-3315-4001-8f27-1126af2b90c3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:13.069780 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4026b801-3315-4001-8f27-1126af2b90c3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:13.070212 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4026b801-3315-4001-8f27-1126af2b90c3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:13.070985 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4026b801-3315-4001-8f27-1126af2b90c3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:13.071603 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4026b801-3315-4001-8f27-1126af2b90c3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:13.236481 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-4026b801-3315-4001-8f27-1126af2b90c3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:13.245104 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-4026b801-3315-4001-8f27-1126af2b90c3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.186748 Jun 22 08:59:13.245905 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 110/196] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:13 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:13.260535 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-82a966e4-839c-4a1b-91e0-557c8adf11fd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:13.260760 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-82a966e4-839c-4a1b-91e0-557c8adf11fd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:13.268038 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-82a966e4-839c-4a1b-91e0-557c8adf11fd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:13.268038 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-82a966e4-839c-4a1b-91e0-557c8adf11fd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:13.268974 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-82a966e4-839c-4a1b-91e0-557c8adf11fd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:13.269417 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-82a966e4-839c-4a1b-91e0-557c8adf11fd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:13.417643 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-82a966e4-839c-4a1b-91e0-557c8adf11fd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:13.425828 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-82a966e4-839c-4a1b-91e0-557c8adf11fd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.169976 Jun 22 08:59:13.426392 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 111/197] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:13 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:13.811736 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e85fe2ff-acf0-4bcb-af93-19566f068f67 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:13.812411 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e85fe2ff-acf0-4bcb-af93-19566f068f67 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:13.819793 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e85fe2ff-acf0-4bcb-af93-19566f068f67 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:13.820252 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e85fe2ff-acf0-4bcb-af93-19566f068f67 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:13.821142 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e85fe2ff-acf0-4bcb-af93-19566f068f67 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:13.821474 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e85fe2ff-acf0-4bcb-af93-19566f068f67 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:13.994771 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-e85fe2ff-acf0-4bcb-af93-19566f068f67 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:14.004149 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e85fe2ff-acf0-4bcb-af93-19566f068f67 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.203958 Jun 22 08:59:14.005196 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 112/198] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:13 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:14.021109 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-41904c6c-0b3d-46d1-ae41-c1f69210c359 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:14.021109 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-41904c6c-0b3d-46d1-ae41-c1f69210c359 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:14.028018 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-41904c6c-0b3d-46d1-ae41-c1f69210c359 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:14.028473 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-41904c6c-0b3d-46d1-ae41-c1f69210c359 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:14.039108 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-41904c6c-0b3d-46d1-ae41-c1f69210c359 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:14.043879 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-41904c6c-0b3d-46d1-ae41-c1f69210c359 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:14.236541 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-41904c6c-0b3d-46d1-ae41-c1f69210c359 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:14.260152 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-41904c6c-0b3d-46d1-ae41-c1f69210c359 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:14.261699 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-41904c6c-0b3d-46d1-ae41-c1f69210c359 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:14.267066 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-41904c6c-0b3d-46d1-ae41-c1f69210c359 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.250401 Jun 22 08:59:14.267533 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 113/199] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:14 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 08:59:14.272752 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-998021f1-ef86-4cf6-9de1-93b3b210bbc4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:14.273425 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-998021f1-ef86-4cf6-9de1-93b3b210bbc4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:14.296656 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-998021f1-ef86-4cf6-9de1-93b3b210bbc4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:14.298941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-998021f1-ef86-4cf6-9de1-93b3b210bbc4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:14.299789 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-998021f1-ef86-4cf6-9de1-93b3b210bbc4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:14.300410 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-998021f1-ef86-4cf6-9de1-93b3b210bbc4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:14.798422 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-998021f1-ef86-4cf6-9de1-93b3b210bbc4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:14.824178 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-998021f1-ef86-4cf6-9de1-93b3b210bbc4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.555015 Jun 22 08:59:14.824757 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 114/200] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:14 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:14.829970 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-b8a3076b-0098-4c00-84b3-d27e1d5edf7a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:14.830791 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-b8a3076b-0098-4c00-84b3-d27e1d5edf7a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:14.838608 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b8a3076b-0098-4c00-84b3-d27e1d5edf7a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:14.839086 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b8a3076b-0098-4c00-84b3-d27e1d5edf7a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:14.839862 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b8a3076b-0098-4c00-84b3-d27e1d5edf7a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:14.840450 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b8a3076b-0098-4c00-84b3-d27e1d5edf7a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:14.989203 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-b8a3076b-0098-4c00-84b3-d27e1d5edf7a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:14.997320 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-b8a3076b-0098-4c00-84b3-d27e1d5edf7a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.171484 Jun 22 08:59:15.000071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 115/201] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:14 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:15.003574 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-60419591-73e0-46e6-8d8d-717931aac7b2 req-07f3a779-0813-438c-af02-b74b5c4ee778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dce83571-cd21-48a3-b54d-b6218f563363", "name": "network-vif-plugged", "status": "completed", "tag": "9ecba298-5328-4f62-bebc-dac62013eb8f"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:59:15.011695 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-60419591-73e0-46e6-8d8d-717931aac7b2 req-07f3a779-0813-438c-af02-b74b5c4ee778 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:15.012175 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-60419591-73e0-46e6-8d8d-717931aac7b2 req-07f3a779-0813-438c-af02-b74b5c4ee778 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:15.025015 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-60419591-73e0-46e6-8d8d-717931aac7b2 req-07f3a779-0813-438c-af02-b74b5c4ee778 service nova] Creating event network-vif-plugged:9ecba298-5328-4f62-bebc-dac62013eb8f for instance dce83571-cd21-48a3-b54d-b6218f563363 on hv-cinder-84599 Jun 22 08:59:15.034586 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-60419591-73e0-46e6-8d8d-717931aac7b2 req-07f3a779-0813-438c-af02-b74b5c4ee778 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030584 Jun 22 08:59:15.034586 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 116/202] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 08:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:59:15.036654 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-99721e5f-71da-45f1-ae94-7173574975ee tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:15.037390 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-99721e5f-71da-45f1-ae94-7173574975ee tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:15.043614 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-99721e5f-71da-45f1-ae94-7173574975ee tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:15.044067 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-99721e5f-71da-45f1-ae94-7173574975ee tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:15.044945 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-99721e5f-71da-45f1-ae94-7173574975ee tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:15.045390 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-99721e5f-71da-45f1-ae94-7173574975ee tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:15.093283 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1642e903-5b6c-4bf1-8be3-df6bf9a8fc08 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "POST /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.059308 Jun 22 08:59:15.094346 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 87/203] 10.222.0.16 () {60 vars in 1322 bytes} [Wed Jun 22 08:59:07 2022] POST /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f/os-volume_attachments => generated 194 bytes in 8062 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:59:15.181759 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-99721e5f-71da-45f1-ae94-7173574975ee tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:15.189527 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-99721e5f-71da-45f1-ae94-7173574975ee tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.156766 Jun 22 08:59:15.190094 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 117/204] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:15 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:15.288002 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-8733c748-668c-4e90-a1b0-9157e96ccc69 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:15.288807 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-8733c748-668c-4e90-a1b0-9157e96ccc69 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:15.298240 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8733c748-668c-4e90-a1b0-9157e96ccc69 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:15.298736 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8733c748-668c-4e90-a1b0-9157e96ccc69 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:15.299529 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8733c748-668c-4e90-a1b0-9157e96ccc69 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:15.300052 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8733c748-668c-4e90-a1b0-9157e96ccc69 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:15.435546 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-8733c748-668c-4e90-a1b0-9157e96ccc69 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:15.444740 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-8733c748-668c-4e90-a1b0-9157e96ccc69 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:15.446271 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-8733c748-668c-4e90-a1b0-9157e96ccc69 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:15.447370 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-8733c748-668c-4e90-a1b0-9157e96ccc69 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.164167 Jun 22 08:59:15.453617 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 88/205] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:15 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:59:15.841504 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-284c2ca6-5783-4a60-9080-8dbd477bfe8f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:15.842114 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-284c2ca6-5783-4a60-9080-8dbd477bfe8f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:15.848276 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-284c2ca6-5783-4a60-9080-8dbd477bfe8f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:15.848721 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-284c2ca6-5783-4a60-9080-8dbd477bfe8f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:15.849572 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-284c2ca6-5783-4a60-9080-8dbd477bfe8f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:15.850011 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-284c2ca6-5783-4a60-9080-8dbd477bfe8f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:15.978538 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-284c2ca6-5783-4a60-9080-8dbd477bfe8f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:15.986636 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-284c2ca6-5783-4a60-9080-8dbd477bfe8f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.149028 Jun 22 08:59:15.989998 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 118/206] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:15 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:16.014448 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ebc141a6-1de0-493d-83db-c74d5881834e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:16.015066 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ebc141a6-1de0-493d-83db-c74d5881834e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:16.021192 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ebc141a6-1de0-493d-83db-c74d5881834e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:16.021645 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ebc141a6-1de0-493d-83db-c74d5881834e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:16.022461 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ebc141a6-1de0-493d-83db-c74d5881834e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:16.022898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ebc141a6-1de0-493d-83db-c74d5881834e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:16.151930 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ebc141a6-1de0-493d-83db-c74d5881834e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:16.159999 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ebc141a6-1de0-493d-83db-c74d5881834e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.149376 Jun 22 08:59:16.160556 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 89/207] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:16 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:16.206517 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-fd7afaa9-5a03-42f6-ad76-422b96a328fc tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:16.207121 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-fd7afaa9-5a03-42f6-ad76-422b96a328fc tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:16.213175 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fd7afaa9-5a03-42f6-ad76-422b96a328fc tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:16.213621 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fd7afaa9-5a03-42f6-ad76-422b96a328fc tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:16.214386 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fd7afaa9-5a03-42f6-ad76-422b96a328fc tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:16.214816 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fd7afaa9-5a03-42f6-ad76-422b96a328fc tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:16.383098 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-fd7afaa9-5a03-42f6-ad76-422b96a328fc tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:16.391931 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-fd7afaa9-5a03-42f6-ad76-422b96a328fc tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.189358 Jun 22 08:59:16.401228 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 119/208] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:16 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:16.466586 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-780d423e-831a-4823-8e70-7ecc9c130103 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:16.467185 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-780d423e-831a-4823-8e70-7ecc9c130103 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:16.474267 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-780d423e-831a-4823-8e70-7ecc9c130103 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:16.474711 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-780d423e-831a-4823-8e70-7ecc9c130103 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:16.475460 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-780d423e-831a-4823-8e70-7ecc9c130103 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:16.475892 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-780d423e-831a-4823-8e70-7ecc9c130103 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:16.603862 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-780d423e-831a-4823-8e70-7ecc9c130103 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:16.612103 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-780d423e-831a-4823-8e70-7ecc9c130103 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:16.613649 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-780d423e-831a-4823-8e70-7ecc9c130103 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:16.614738 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-780d423e-831a-4823-8e70-7ecc9c130103 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.152326 Jun 22 08:59:16.615292 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 90/209] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:16 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:59:17.004435 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7143d0d5-e83f-466e-b870-686b1e63a6ec tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:17.005086 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7143d0d5-e83f-466e-b870-686b1e63a6ec tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:17.007722 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-2ea099d8-ef83-44be-91e9-eecb701678fe tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1168507902", "imageRef": "c24d36a8-7909-4174-9b12-42c8d76647ac", "flavorRef": "452", "networks": [{"uuid": "811c3731-2235-4a58-bcd9-ec44095cd913"}]}} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:59:17.011149 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7143d0d5-e83f-466e-b870-686b1e63a6ec tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:17.011604 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7143d0d5-e83f-466e-b870-686b1e63a6ec tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:17.012368 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7143d0d5-e83f-466e-b870-686b1e63a6ec tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:17.012828 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7143d0d5-e83f-466e-b870-686b1e63a6ec tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:17.059102 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.network.neutron [None req-2ea099d8-ef83-44be-91e9-eecb701678fe tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] validate_networks() for [('811c3731-2235-4a58-bcd9-ec44095cd913', None, None, None, None, None)] {{(pid=118024) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 08:59:17.220110 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7143d0d5-e83f-466e-b870-686b1e63a6ec tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:17.227757 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7143d0d5-e83f-466e-b870-686b1e63a6ec tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.228088 Jun 22 08:59:17.228321 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 120/210] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:16 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:17.232705 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-bacfed07-4abe-46c1-93fd-cba3df3a994a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:17.233337 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-bacfed07-4abe-46c1-93fd-cba3df3a994a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:17.240042 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bacfed07-4abe-46c1-93fd-cba3df3a994a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:17.240483 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bacfed07-4abe-46c1-93fd-cba3df3a994a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:17.241267 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bacfed07-4abe-46c1-93fd-cba3df3a994a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:17.241765 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bacfed07-4abe-46c1-93fd-cba3df3a994a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:17.448491 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-bacfed07-4abe-46c1-93fd-cba3df3a994a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:17.456352 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-bacfed07-4abe-46c1-93fd-cba3df3a994a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.226979 Jun 22 08:59:17.456938 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 121/211] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:17 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:17.461283 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9844e645-bece-4614-a641-735920d3adb8 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:17.461884 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9844e645-bece-4614-a641-735920d3adb8 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:17.463655 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=100 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:17.470041 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9844e645-bece-4614-a641-735920d3adb8 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:17.475496 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9844e645-bece-4614-a641-735920d3adb8 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:17.475496 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9844e645-bece-4614-a641-735920d3adb8 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:17.475496 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9844e645-bece-4614-a641-735920d3adb8 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:17.577219 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-2ea099d8-ef83-44be-91e9-eecb701678fe tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Flavor limits 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 08:59:17.577681 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-2ea099d8-ef83-44be-91e9-eecb701678fe tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Image limits 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 08:59:17.578390 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-2ea099d8-ef83-44be-91e9-eecb701678fe tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Flavor pref 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 08:59:17.578868 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-2ea099d8-ef83-44be-91e9-eecb701678fe tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Image pref 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 08:59:17.579344 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-2ea099d8-ef83-44be-91e9-eecb701678fe tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 08:59:17.588967 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2ea099d8-ef83-44be-91e9-eecb701678fe tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:17.589487 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2ea099d8-ef83-44be-91e9-eecb701678fe tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:17.590349 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2ea099d8-ef83-44be-91e9-eecb701678fe tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:17.590853 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2ea099d8-ef83-44be-91e9-eecb701678fe tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:17.608192 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.quota [None req-2ea099d8-ef83-44be-91e9-eecb701678fe tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Getting quotas for project 057f604657a84a1ab5690adec51c01c1. Resources: {'cores', 'instances', 'ram'} {{(pid=118024) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 08:59:17.612855 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.quota [None req-2ea099d8-ef83-44be-91e9-eecb701678fe tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Getting quotas for user 3692a330bd744eb29008156ad6a546ce and project 057f604657a84a1ab5690adec51c01c1. Resources: {'cores', 'instances', 'ram'} {{(pid=118024) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 08:59:17.622264 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9844e645-bece-4614-a641-735920d3adb8 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:17.623863 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-2ea099d8-ef83-44be-91e9-eecb701678fe tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Going to run 1 instances... {{(pid=118024) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 08:59:17.627024 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-2ea099d8-ef83-44be-91e9-eecb701678fe tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c24d36a8-7909-4174-9b12-42c8d76647ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118024) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 08:59:17.630256 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9844e645-bece-4614-a641-735920d3adb8 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.172334 Jun 22 08:59:17.630833 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 122/212] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:17 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:17.635364 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-bc9f8322-9052-43d7-b1d7-78afd1c87cf0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:17.635965 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-bc9f8322-9052-43d7-b1d7-78afd1c87cf0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:17.641855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bc9f8322-9052-43d7-b1d7-78afd1c87cf0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:17.642307 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bc9f8322-9052-43d7-b1d7-78afd1c87cf0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:17.643095 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bc9f8322-9052-43d7-b1d7-78afd1c87cf0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:17.643527 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bc9f8322-9052-43d7-b1d7-78afd1c87cf0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:17.647538 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=100 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:17.765791 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-2ea099d8-ef83-44be-91e9-eecb701678fe tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.761483 Jun 22 08:59:17.766523 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 91/213] 10.222.0.16 () {60 vars in 1146 bytes} [Wed Jun 22 08:59:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 08:59:17.774691 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-bc9f8322-9052-43d7-b1d7-78afd1c87cf0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:17.777615 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-27005503-9447-44e0-9c26-36f3c6537e15 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:17.778304 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-27005503-9447-44e0-9c26-36f3c6537e15 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:17.783496 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-bc9f8322-9052-43d7-b1d7-78afd1c87cf0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:17.785264 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-bc9f8322-9052-43d7-b1d7-78afd1c87cf0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:17.786582 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-bc9f8322-9052-43d7-b1d7-78afd1c87cf0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.154829 Jun 22 08:59:17.787323 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 123/214] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:17 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:59:17.834321 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-27005503-9447-44e0-9c26-36f3c6537e15 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:17.842372 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-27005503-9447-44e0-9c26-36f3c6537e15 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1214 microversion: 2.1 time: 0.068568 Jun 22 08:59:17.842836 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 92/215] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:17 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:18.244722 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-6ab024cf-3ff2-4c4d-9d98-13a0d159ca48 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:18.245361 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-6ab024cf-3ff2-4c4d-9d98-13a0d159ca48 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:18.252045 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6ab024cf-3ff2-4c4d-9d98-13a0d159ca48 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:18.252496 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6ab024cf-3ff2-4c4d-9d98-13a0d159ca48 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:18.253293 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6ab024cf-3ff2-4c4d-9d98-13a0d159ca48 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:18.253735 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6ab024cf-3ff2-4c4d-9d98-13a0d159ca48 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:18.380332 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-6ab024cf-3ff2-4c4d-9d98-13a0d159ca48 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:18.388174 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-6ab024cf-3ff2-4c4d-9d98-13a0d159ca48 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.147281 Jun 22 08:59:18.388742 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 124/216] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:18 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:18.473875 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-194916ba-5129-4ec2-b6df-b4e1ad6829c4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:18.474730 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-194916ba-5129-4ec2-b6df-b4e1ad6829c4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:18.482591 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-194916ba-5129-4ec2-b6df-b4e1ad6829c4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:18.483267 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-194916ba-5129-4ec2-b6df-b4e1ad6829c4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:18.486837 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-194916ba-5129-4ec2-b6df-b4e1ad6829c4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:18.486837 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-194916ba-5129-4ec2-b6df-b4e1ad6829c4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:18.621480 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-194916ba-5129-4ec2-b6df-b4e1ad6829c4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:18.629477 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-194916ba-5129-4ec2-b6df-b4e1ad6829c4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.160210 Jun 22 08:59:18.630033 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 93/217] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:18 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:18.646943 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-eeb50c3a-6d20-4480-b7d3-be370285b1b3 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:18.647556 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-eeb50c3a-6d20-4480-b7d3-be370285b1b3 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:18.653553 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eeb50c3a-6d20-4480-b7d3-be370285b1b3 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:18.654008 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eeb50c3a-6d20-4480-b7d3-be370285b1b3 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:18.654771 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eeb50c3a-6d20-4480-b7d3-be370285b1b3 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:18.655212 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eeb50c3a-6d20-4480-b7d3-be370285b1b3 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:18.784500 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-eeb50c3a-6d20-4480-b7d3-be370285b1b3 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:18.792118 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-eeb50c3a-6d20-4480-b7d3-be370285b1b3 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.148997 Jun 22 08:59:18.792683 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 125/218] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:18 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:18.804998 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f523b8cb-d8f8-4b73-b2aa-d09c14431e60 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:18.805647 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f523b8cb-d8f8-4b73-b2aa-d09c14431e60 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:18.815426 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f523b8cb-d8f8-4b73-b2aa-d09c14431e60 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:18.816247 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f523b8cb-d8f8-4b73-b2aa-d09c14431e60 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:18.817125 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f523b8cb-d8f8-4b73-b2aa-d09c14431e60 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:18.817559 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f523b8cb-d8f8-4b73-b2aa-d09c14431e60 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:18.859868 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-1ba57aec-eca4-463a-9846-edb6eae0df72 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:18.860642 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-1ba57aec-eca4-463a-9846-edb6eae0df72 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:18.866841 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1ba57aec-eca4-463a-9846-edb6eae0df72 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:18.867282 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1ba57aec-eca4-463a-9846-edb6eae0df72 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:18.868038 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1ba57aec-eca4-463a-9846-edb6eae0df72 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:18.868470 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1ba57aec-eca4-463a-9846-edb6eae0df72 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:18.949378 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-1ba57aec-eca4-463a-9846-edb6eae0df72 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:18.956984 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-1ba57aec-eca4-463a-9846-edb6eae0df72 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1218 microversion: 2.1 time: 0.101427 Jun 22 08:59:18.957551 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 126/219] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:18 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:18.979240 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-f523b8cb-d8f8-4b73-b2aa-d09c14431e60 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:18.987793 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-f523b8cb-d8f8-4b73-b2aa-d09c14431e60 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:18.989355 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-f523b8cb-d8f8-4b73-b2aa-d09c14431e60 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:18.990441 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f523b8cb-d8f8-4b73-b2aa-d09c14431e60 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.189348 Jun 22 08:59:18.990994 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 94/220] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:18 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:59:19.405539 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-bf1eba65-956f-4e07-a4f4-fcdd1d27b001 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:19.406169 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-bf1eba65-956f-4e07-a4f4-fcdd1d27b001 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:19.413112 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bf1eba65-956f-4e07-a4f4-fcdd1d27b001 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:19.413562 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bf1eba65-956f-4e07-a4f4-fcdd1d27b001 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:19.414312 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bf1eba65-956f-4e07-a4f4-fcdd1d27b001 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:19.414743 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bf1eba65-956f-4e07-a4f4-fcdd1d27b001 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:19.542741 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-bf1eba65-956f-4e07-a4f4-fcdd1d27b001 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:19.550455 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-bf1eba65-956f-4e07-a4f4-fcdd1d27b001 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.148732 Jun 22 08:59:19.551022 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 127/221] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:19 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:19.646732 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-471caa04-31b9-417d-8639-518e0d8990af tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:19.647348 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-471caa04-31b9-417d-8639-518e0d8990af tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:19.653817 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-471caa04-31b9-417d-8639-518e0d8990af tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:19.654272 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-471caa04-31b9-417d-8639-518e0d8990af tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:19.655040 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-471caa04-31b9-417d-8639-518e0d8990af tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:19.655480 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-471caa04-31b9-417d-8639-518e0d8990af tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:19.783273 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-471caa04-31b9-417d-8639-518e0d8990af tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:19.790557 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-471caa04-31b9-417d-8639-518e0d8990af tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.147685 Jun 22 08:59:19.791262 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 95/222] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:19 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:19.810174 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-8ec8bb44-f6df-48b7-95c2-5d38a509b8e6 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:19.811217 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-8ec8bb44-f6df-48b7-95c2-5d38a509b8e6 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:19.817916 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8ec8bb44-f6df-48b7-95c2-5d38a509b8e6 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:19.818358 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8ec8bb44-f6df-48b7-95c2-5d38a509b8e6 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:19.819118 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8ec8bb44-f6df-48b7-95c2-5d38a509b8e6 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:19.819553 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8ec8bb44-f6df-48b7-95c2-5d38a509b8e6 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:19.946118 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-8ec8bb44-f6df-48b7-95c2-5d38a509b8e6 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:19.954611 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-8ec8bb44-f6df-48b7-95c2-5d38a509b8e6 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.148568 Jun 22 08:59:19.955173 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 128/223] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:19 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:19.974135 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-da919fdd-1e5f-4497-868f-c4b218e3295f tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:19.974753 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-da919fdd-1e5f-4497-868f-c4b218e3295f tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:19.980832 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-da919fdd-1e5f-4497-868f-c4b218e3295f tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:19.981287 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-da919fdd-1e5f-4497-868f-c4b218e3295f tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:19.982049 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-da919fdd-1e5f-4497-868f-c4b218e3295f tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:19.982637 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-da919fdd-1e5f-4497-868f-c4b218e3295f tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:20.008794 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-51133d8a-4554-45f6-af92-c0d57f70e63a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:20.009486 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-51133d8a-4554-45f6-af92-c0d57f70e63a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:20.016045 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-51133d8a-4554-45f6-af92-c0d57f70e63a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:20.016495 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-51133d8a-4554-45f6-af92-c0d57f70e63a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:20.017276 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-51133d8a-4554-45f6-af92-c0d57f70e63a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:20.017711 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-51133d8a-4554-45f6-af92-c0d57f70e63a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:20.043368 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-da919fdd-1e5f-4497-868f-c4b218e3295f tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:20.051216 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-da919fdd-1e5f-4497-868f-c4b218e3295f tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1218 microversion: 2.1 time: 0.080956 Jun 22 08:59:20.051783 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 96/224] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:19 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:20.146831 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-51133d8a-4554-45f6-af92-c0d57f70e63a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:20.154650 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-51133d8a-4554-45f6-af92-c0d57f70e63a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:20.156346 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-51133d8a-4554-45f6-af92-c0d57f70e63a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:20.157798 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-51133d8a-4554-45f6-af92-c0d57f70e63a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.152779 Jun 22 08:59:20.158352 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 129/225] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:20 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:59:20.567124 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-7476891a-06ee-49f5-b979-0ad3f9a0973c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:20.567803 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-7476891a-06ee-49f5-b979-0ad3f9a0973c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:20.573829 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7476891a-06ee-49f5-b979-0ad3f9a0973c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:20.574286 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7476891a-06ee-49f5-b979-0ad3f9a0973c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:20.575057 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7476891a-06ee-49f5-b979-0ad3f9a0973c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:20.575500 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7476891a-06ee-49f5-b979-0ad3f9a0973c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:20.701369 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-7476891a-06ee-49f5-b979-0ad3f9a0973c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:20.708840 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-7476891a-06ee-49f5-b979-0ad3f9a0973c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.145545 Jun 22 08:59:20.709400 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 97/226] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:20 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:20.807840 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-ab723696-3b0f-4ac0-8574-8b715344d332 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:20.808447 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-ab723696-3b0f-4ac0-8574-8b715344d332 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:20.815140 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ab723696-3b0f-4ac0-8574-8b715344d332 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:20.815584 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ab723696-3b0f-4ac0-8574-8b715344d332 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:20.816355 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ab723696-3b0f-4ac0-8574-8b715344d332 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:20.816915 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ab723696-3b0f-4ac0-8574-8b715344d332 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:20.950077 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-ab723696-3b0f-4ac0-8574-8b715344d332 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:20.958110 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-ab723696-3b0f-4ac0-8574-8b715344d332 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.154464 Jun 22 08:59:20.964542 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 130/227] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:20 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:20.972103 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b2fee3bd-9d64-4115-acc8-73dfbfcb603a tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:20.972717 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-b2fee3bd-9d64-4115-acc8-73dfbfcb603a tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:20.978780 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b2fee3bd-9d64-4115-acc8-73dfbfcb603a tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:20.979234 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b2fee3bd-9d64-4115-acc8-73dfbfcb603a tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:20.979995 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b2fee3bd-9d64-4115-acc8-73dfbfcb603a tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:20.980440 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b2fee3bd-9d64-4115-acc8-73dfbfcb603a tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:21.068832 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2111047b-2465-421f-a8da-62bbcd985cb3 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:21.069363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2111047b-2465-421f-a8da-62bbcd985cb3 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:21.075482 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2111047b-2465-421f-a8da-62bbcd985cb3 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:21.077304 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2111047b-2465-421f-a8da-62bbcd985cb3 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:21.077304 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2111047b-2465-421f-a8da-62bbcd985cb3 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:21.077304 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2111047b-2465-421f-a8da-62bbcd985cb3 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:21.107478 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-b2fee3bd-9d64-4115-acc8-73dfbfcb603a tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:21.115176 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-b2fee3bd-9d64-4115-acc8-73dfbfcb603a tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.147714 Jun 22 08:59:21.115754 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 98/228] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:20 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:21.137689 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-2111047b-2465-421f-a8da-62bbcd985cb3 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:21.145845 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2111047b-2465-421f-a8da-62bbcd985cb3 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1218 microversion: 2.1 time: 0.080920 Jun 22 08:59:21.146538 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 131/229] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:21 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:21.175348 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-69c32c6b-f233-4cbe-822b-5d30a9d1e1ee tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:21.175963 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-69c32c6b-f233-4cbe-822b-5d30a9d1e1ee tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:21.182300 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-69c32c6b-f233-4cbe-822b-5d30a9d1e1ee tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:21.186255 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-69c32c6b-f233-4cbe-822b-5d30a9d1e1ee tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:21.186255 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-69c32c6b-f233-4cbe-822b-5d30a9d1e1ee tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:21.186255 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-69c32c6b-f233-4cbe-822b-5d30a9d1e1ee tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:21.314662 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-69c32c6b-f233-4cbe-822b-5d30a9d1e1ee tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:21.322957 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-69c32c6b-f233-4cbe-822b-5d30a9d1e1ee tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:21.324394 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-69c32c6b-f233-4cbe-822b-5d30a9d1e1ee tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:21.325514 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-69c32c6b-f233-4cbe-822b-5d30a9d1e1ee tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.154109 Jun 22 08:59:21.326060 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 99/230] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:21 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:59:21.725345 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-b0ff1aa6-8b65-42a9-b9bf-557bcb165d77 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:21.725958 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-b0ff1aa6-8b65-42a9-b9bf-557bcb165d77 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:21.731998 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b0ff1aa6-8b65-42a9-b9bf-557bcb165d77 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:21.732456 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b0ff1aa6-8b65-42a9-b9bf-557bcb165d77 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:21.733242 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b0ff1aa6-8b65-42a9-b9bf-557bcb165d77 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:21.733679 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b0ff1aa6-8b65-42a9-b9bf-557bcb165d77 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:21.858473 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-b0ff1aa6-8b65-42a9-b9bf-557bcb165d77 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:21.866731 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-b0ff1aa6-8b65-42a9-b9bf-557bcb165d77 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.145097 Jun 22 08:59:21.867426 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 132/231] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:21 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:21.975560 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-152d732b-ddea-41e4-b2d7-137801a4d01e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:21.976173 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-152d732b-ddea-41e4-b2d7-137801a4d01e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:21.982634 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-152d732b-ddea-41e4-b2d7-137801a4d01e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:21.983077 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-152d732b-ddea-41e4-b2d7-137801a4d01e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:21.984332 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-152d732b-ddea-41e4-b2d7-137801a4d01e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:21.984927 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-152d732b-ddea-41e4-b2d7-137801a4d01e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:22.117134 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-152d732b-ddea-41e4-b2d7-137801a4d01e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:22.124800 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-152d732b-ddea-41e4-b2d7-137801a4d01e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.153165 Jun 22 08:59:22.126013 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 100/232] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:21 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:22.136746 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-79d922e7-46be-44ca-a77a-690cefbfdca7 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:22.137427 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-79d922e7-46be-44ca-a77a-690cefbfdca7 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:22.143730 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-79d922e7-46be-44ca-a77a-690cefbfdca7 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:22.144182 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-79d922e7-46be-44ca-a77a-690cefbfdca7 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:22.144972 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-79d922e7-46be-44ca-a77a-690cefbfdca7 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:22.145434 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-79d922e7-46be-44ca-a77a-690cefbfdca7 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:22.162990 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-0947692a-64db-49c3-b5b8-39fd9aa85b17 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:22.163637 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-0947692a-64db-49c3-b5b8-39fd9aa85b17 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:22.170014 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0947692a-64db-49c3-b5b8-39fd9aa85b17 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:22.170470 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0947692a-64db-49c3-b5b8-39fd9aa85b17 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:22.171236 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0947692a-64db-49c3-b5b8-39fd9aa85b17 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:22.173043 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0947692a-64db-49c3-b5b8-39fd9aa85b17 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:22.263946 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-0947692a-64db-49c3-b5b8-39fd9aa85b17 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:22.272796 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-0947692a-64db-49c3-b5b8-39fd9aa85b17 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1218 microversion: 2.1 time: 0.113231 Jun 22 08:59:22.273697 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 101/233] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:22 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1218 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:22.311073 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-79d922e7-46be-44ca-a77a-690cefbfdca7 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:22.319642 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-79d922e7-46be-44ca-a77a-690cefbfdca7 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.192041 Jun 22 08:59:22.320451 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 133/234] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:22 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:22.344312 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1e054028-8efb-4ea8-877a-e84ce433236b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:22.344989 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1e054028-8efb-4ea8-877a-e84ce433236b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:22.351407 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1e054028-8efb-4ea8-877a-e84ce433236b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:22.351858 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1e054028-8efb-4ea8-877a-e84ce433236b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:22.352629 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1e054028-8efb-4ea8-877a-e84ce433236b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:22.353667 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1e054028-8efb-4ea8-877a-e84ce433236b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:22.490970 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-1e054028-8efb-4ea8-877a-e84ce433236b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:22.498847 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-1e054028-8efb-4ea8-877a-e84ce433236b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:22.500410 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-1e054028-8efb-4ea8-877a-e84ce433236b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:22.501537 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1e054028-8efb-4ea8-877a-e84ce433236b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.161963 Jun 22 08:59:22.502091 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 102/235] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:22 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:59:22.884491 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-657fc82d-d3c1-4cf0-b19d-e15fe15b419c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:22.885191 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-657fc82d-d3c1-4cf0-b19d-e15fe15b419c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:22.892024 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-657fc82d-d3c1-4cf0-b19d-e15fe15b419c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:22.892470 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-657fc82d-d3c1-4cf0-b19d-e15fe15b419c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:22.893255 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-657fc82d-d3c1-4cf0-b19d-e15fe15b419c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:22.893697 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-657fc82d-d3c1-4cf0-b19d-e15fe15b419c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:23.111155 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-657fc82d-d3c1-4cf0-b19d-e15fe15b419c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:23.118942 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-657fc82d-d3c1-4cf0-b19d-e15fe15b419c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.238354 Jun 22 08:59:23.129196 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 134/236] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:22 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:23.143400 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-4c4c6ae0-288f-411b-9102-bf9c79fa10c0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:23.143926 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-4c4c6ae0-288f-411b-9102-bf9c79fa10c0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:23.150638 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4c4c6ae0-288f-411b-9102-bf9c79fa10c0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:23.151290 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4c4c6ae0-288f-411b-9102-bf9c79fa10c0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:23.152095 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4c4c6ae0-288f-411b-9102-bf9c79fa10c0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:23.152691 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4c4c6ae0-288f-411b-9102-bf9c79fa10c0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:23.291849 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-eb253537-8335-4158-9729-b2f548f33ce0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:23.296980 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-eb253537-8335-4158-9729-b2f548f33ce0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:23.297714 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-4c4c6ae0-288f-411b-9102-bf9c79fa10c0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:23.300665 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eb253537-8335-4158-9729-b2f548f33ce0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:23.301237 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eb253537-8335-4158-9729-b2f548f33ce0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:23.302122 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eb253537-8335-4158-9729-b2f548f33ce0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:23.302655 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eb253537-8335-4158-9729-b2f548f33ce0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:23.305546 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-4c4c6ae0-288f-411b-9102-bf9c79fa10c0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.166715 Jun 22 08:59:23.308827 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 103/237] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:23 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:23.336612 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-07a1d3d5-a8b8-4ec9-a391-0141a3413e91 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:23.337410 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-07a1d3d5-a8b8-4ec9-a391-0141a3413e91 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:23.344328 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-07a1d3d5-a8b8-4ec9-a391-0141a3413e91 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:23.345193 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-07a1d3d5-a8b8-4ec9-a391-0141a3413e91 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:23.345968 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-07a1d3d5-a8b8-4ec9-a391-0141a3413e91 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:23.348194 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-07a1d3d5-a8b8-4ec9-a391-0141a3413e91 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:23.354162 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:23.372295 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-eb253537-8335-4158-9729-b2f548f33ce0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:23.381681 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-eb253537-8335-4158-9729-b2f548f33ce0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1218 microversion: 2.1 time: 0.093747 Jun 22 08:59:23.382472 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 135/238] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:23 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:23.481301 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-07a1d3d5-a8b8-4ec9-a391-0141a3413e91 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:23.491206 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-07a1d3d5-a8b8-4ec9-a391-0141a3413e91 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.158446 Jun 22 08:59:23.491818 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 104/239] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:23 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:23.519661 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e47e9541-67ec-4d97-83a7-c2f51181daaa tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:23.520272 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e47e9541-67ec-4d97-83a7-c2f51181daaa tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:23.526286 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e47e9541-67ec-4d97-83a7-c2f51181daaa tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:23.526729 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e47e9541-67ec-4d97-83a7-c2f51181daaa tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:23.527484 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e47e9541-67ec-4d97-83a7-c2f51181daaa tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:23.527919 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e47e9541-67ec-4d97-83a7-c2f51181daaa tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:23.724745 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-e47e9541-67ec-4d97-83a7-c2f51181daaa tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:23.733689 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-e47e9541-67ec-4d97-83a7-c2f51181daaa tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:23.736066 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-e47e9541-67ec-4d97-83a7-c2f51181daaa tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:23.737268 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e47e9541-67ec-4d97-83a7-c2f51181daaa tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.221679 Jun 22 08:59:23.737839 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 136/240] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:23 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:59:24.136462 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1a6f1dad-03b0-4ea7-875a-b76f1613f03f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:24.137198 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1a6f1dad-03b0-4ea7-875a-b76f1613f03f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:24.144636 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1a6f1dad-03b0-4ea7-875a-b76f1613f03f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:24.145239 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1a6f1dad-03b0-4ea7-875a-b76f1613f03f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:24.145866 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1a6f1dad-03b0-4ea7-875a-b76f1613f03f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:24.146333 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1a6f1dad-03b0-4ea7-875a-b76f1613f03f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:24.278314 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-1a6f1dad-03b0-4ea7-875a-b76f1613f03f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:24.286211 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1a6f1dad-03b0-4ea7-875a-b76f1613f03f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1322 microversion: 2.1 time: 0.153673 Jun 22 08:59:24.286774 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 105/241] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:24 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:24.325585 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-551f7dac-9439-413a-8307-c883e2c7c65a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:24.336767 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-551f7dac-9439-413a-8307-c883e2c7c65a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:24.343398 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-551f7dac-9439-413a-8307-c883e2c7c65a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:24.344156 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-551f7dac-9439-413a-8307-c883e2c7c65a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:24.345024 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-551f7dac-9439-413a-8307-c883e2c7c65a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:24.345464 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-551f7dac-9439-413a-8307-c883e2c7c65a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:24.401270 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f25fe598-b6eb-42f0-b8dc-484e9b6ad244 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:24.402009 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f25fe598-b6eb-42f0-b8dc-484e9b6ad244 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:24.408274 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f25fe598-b6eb-42f0-b8dc-484e9b6ad244 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:24.408915 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f25fe598-b6eb-42f0-b8dc-484e9b6ad244 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:24.409956 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f25fe598-b6eb-42f0-b8dc-484e9b6ad244 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:24.410711 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f25fe598-b6eb-42f0-b8dc-484e9b6ad244 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:24.484596 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-f25fe598-b6eb-42f0-b8dc-484e9b6ad244 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:24.495616 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f25fe598-b6eb-42f0-b8dc-484e9b6ad244 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1218 microversion: 2.1 time: 0.099319 Jun 22 08:59:24.497339 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 106/242] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:24 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:24.509933 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-124e340f-e529-4fdc-a273-21827868a24f tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:24.510586 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-124e340f-e529-4fdc-a273-21827868a24f tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:24.510703 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-551f7dac-9439-413a-8307-c883e2c7c65a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:24.518670 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-124e340f-e529-4fdc-a273-21827868a24f tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:24.519244 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-124e340f-e529-4fdc-a273-21827868a24f tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:24.520080 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-124e340f-e529-4fdc-a273-21827868a24f tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:24.520521 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-124e340f-e529-4fdc-a273-21827868a24f tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:24.523765 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-551f7dac-9439-413a-8307-c883e2c7c65a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.202014 Jun 22 08:59:24.524365 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 137/243] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:24 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:24.675947 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-124e340f-e529-4fdc-a273-21827868a24f tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:24.679675 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-124e340f-e529-4fdc-a273-21827868a24f tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.174058 Jun 22 08:59:24.680223 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 107/244] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:24 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:24.760580 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7ccce772-3213-43b5-98e6-7cca7b26268d tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:24.760580 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7ccce772-3213-43b5-98e6-7cca7b26268d tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:24.765052 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7ccce772-3213-43b5-98e6-7cca7b26268d tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:24.766418 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7ccce772-3213-43b5-98e6-7cca7b26268d tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:24.767358 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7ccce772-3213-43b5-98e6-7cca7b26268d tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:24.772913 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7ccce772-3213-43b5-98e6-7cca7b26268d tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:24.911719 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7ccce772-3213-43b5-98e6-7cca7b26268d tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:24.919865 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7ccce772-3213-43b5-98e6-7cca7b26268d tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:24.923599 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7ccce772-3213-43b5-98e6-7cca7b26268d tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:24.923599 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7ccce772-3213-43b5-98e6-7cca7b26268d tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.170758 Jun 22 08:59:24.923599 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 138/245] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:24 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:59:25.303441 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c527c891-b6a3-4b33-825f-506229653cf3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:25.304254 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c527c891-b6a3-4b33-825f-506229653cf3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:25.312272 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c527c891-b6a3-4b33-825f-506229653cf3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:25.312723 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c527c891-b6a3-4b33-825f-506229653cf3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:25.313563 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c527c891-b6a3-4b33-825f-506229653cf3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:25.314042 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c527c891-b6a3-4b33-825f-506229653cf3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:25.443848 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-c527c891-b6a3-4b33-825f-506229653cf3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:25.451376 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c527c891-b6a3-4b33-825f-506229653cf3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1516 microversion: 2.1 time: 0.152242 Jun 22 08:59:25.451952 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 108/246] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:25 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:25.470119 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-76956059-f1f3-476c-8c55-9ccf36175fc9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:59:25.471122 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-76956059-f1f3-476c-8c55-9ccf36175fc9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:25.477226 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-76956059-f1f3-476c-8c55-9ccf36175fc9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:25.477680 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-76956059-f1f3-476c-8c55-9ccf36175fc9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:25.478442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-76956059-f1f3-476c-8c55-9ccf36175fc9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:25.478884 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-76956059-f1f3-476c-8c55-9ccf36175fc9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:25.514840 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-31937a03-b49f-4510-bf6b-80372e96aa55 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:25.515437 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-31937a03-b49f-4510-bf6b-80372e96aa55 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:25.521342 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-31937a03-b49f-4510-bf6b-80372e96aa55 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:25.521795 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-31937a03-b49f-4510-bf6b-80372e96aa55 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:25.522552 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-31937a03-b49f-4510-bf6b-80372e96aa55 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:25.522992 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-31937a03-b49f-4510-bf6b-80372e96aa55 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:25.540857 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.objects.instance [None req-76956059-f1f3-476c-8c55-9ccf36175fc9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lazy-loading 'flavor' on Instance uuid 699207bb-360b-451e-85ee-a5cc21227d44 {{(pid=118025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 08:59:25.570855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=100 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:25.587670 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-31937a03-b49f-4510-bf6b-80372e96aa55 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:25.595737 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-31937a03-b49f-4510-bf6b-80372e96aa55 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1218 microversion: 2.1 time: 0.084764 Jun 22 08:59:25.596311 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 109/247] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:25 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:25.610562 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-39199c20-0d89-4100-9f97-fc34a8cde7ec tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:25.611229 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-39199c20-0d89-4100-9f97-fc34a8cde7ec tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:25.617423 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-39199c20-0d89-4100-9f97-fc34a8cde7ec tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:25.617870 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-39199c20-0d89-4100-9f97-fc34a8cde7ec tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:25.618625 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-39199c20-0d89-4100-9f97-fc34a8cde7ec tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:25.619060 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-39199c20-0d89-4100-9f97-fc34a8cde7ec tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:25.753104 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-39199c20-0d89-4100-9f97-fc34a8cde7ec tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:25.760879 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-39199c20-0d89-4100-9f97-fc34a8cde7ec tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.163513 Jun 22 08:59:25.761552 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 110/248] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:25 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:25.766298 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-893fdd41-b761-443f-b374-a5f2f7db7342 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:25.767001 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-893fdd41-b761-443f-b374-a5f2f7db7342 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:25.773507 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-893fdd41-b761-443f-b374-a5f2f7db7342 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:25.773973 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-893fdd41-b761-443f-b374-a5f2f7db7342 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:25.776276 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-893fdd41-b761-443f-b374-a5f2f7db7342 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:25.776914 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-893fdd41-b761-443f-b374-a5f2f7db7342 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:25.858017 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-76956059-f1f3-476c-8c55-9ccf36175fc9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "POST /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44/action" status: 200 len: 32 microversion: 2.1 time: 0.391843 Jun 22 08:59:25.864942 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 139/249] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jun 22 08:59:25 2022] POST /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44/action => generated 32 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 22 08:59:25.868291 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-46ed8b88-f7b6-4441-9cf2-e399aa8a602a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:25.869017 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-46ed8b88-f7b6-4441-9cf2-e399aa8a602a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:25.875958 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-46ed8b88-f7b6-4441-9cf2-e399aa8a602a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:25.876410 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-46ed8b88-f7b6-4441-9cf2-e399aa8a602a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:25.877299 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-46ed8b88-f7b6-4441-9cf2-e399aa8a602a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:25.877740 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-46ed8b88-f7b6-4441-9cf2-e399aa8a602a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:25.912666 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-893fdd41-b761-443f-b374-a5f2f7db7342 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:25.920384 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-893fdd41-b761-443f-b374-a5f2f7db7342 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.157755 Jun 22 08:59:25.922824 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 111/250] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:25 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:25.943476 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-697b62fe-68ff-4844-a275-a10c748496a2 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:25.944801 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-697b62fe-68ff-4844-a275-a10c748496a2 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:25.954130 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-697b62fe-68ff-4844-a275-a10c748496a2 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:25.954583 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-697b62fe-68ff-4844-a275-a10c748496a2 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:25.957566 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-697b62fe-68ff-4844-a275-a10c748496a2 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:25.957566 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-697b62fe-68ff-4844-a275-a10c748496a2 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:26.071555 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-46ed8b88-f7b6-4441-9cf2-e399aa8a602a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:26.083448 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-46ed8b88-f7b6-4441-9cf2-e399aa8a602a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1522 microversion: 2.1 time: 0.215690 Jun 22 08:59:26.083448 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 140/251] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:25 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:26.157604 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-697b62fe-68ff-4844-a275-a10c748496a2 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:26.165999 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-697b62fe-68ff-4844-a275-a10c748496a2 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:26.167502 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-697b62fe-68ff-4844-a275-a10c748496a2 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:26.168603 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-697b62fe-68ff-4844-a275-a10c748496a2 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.230679 Jun 22 08:59:26.169252 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 112/252] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:25 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 08:59:26.613357 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-5a5838fb-a670-44a8-a9d2-715d75460072 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:26.614052 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-5a5838fb-a670-44a8-a9d2-715d75460072 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:26.620163 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5a5838fb-a670-44a8-a9d2-715d75460072 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:26.620604 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5a5838fb-a670-44a8-a9d2-715d75460072 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:26.621393 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5a5838fb-a670-44a8-a9d2-715d75460072 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:26.621822 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5a5838fb-a670-44a8-a9d2-715d75460072 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:26.686104 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-5a5838fb-a670-44a8-a9d2-715d75460072 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:26.693785 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-5a5838fb-a670-44a8-a9d2-715d75460072 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1218 microversion: 2.1 time: 0.084864 Jun 22 08:59:26.694339 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 141/253] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:26 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:26.777725 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c8970cf4-9af3-465a-bcff-319866721b8d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:26.778453 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c8970cf4-9af3-465a-bcff-319866721b8d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:26.785148 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c8970cf4-9af3-465a-bcff-319866721b8d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:26.785600 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c8970cf4-9af3-465a-bcff-319866721b8d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:26.786363 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c8970cf4-9af3-465a-bcff-319866721b8d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:26.786796 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c8970cf4-9af3-465a-bcff-319866721b8d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:26.917934 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-c8970cf4-9af3-465a-bcff-319866721b8d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:26.925752 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c8970cf4-9af3-465a-bcff-319866721b8d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.151869 Jun 22 08:59:26.931222 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 113/254] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:26 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:26.942069 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-5d7edb5f-49eb-43cd-8d1e-450caa223d94 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:26.942705 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-5d7edb5f-49eb-43cd-8d1e-450caa223d94 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:26.948662 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5d7edb5f-49eb-43cd-8d1e-450caa223d94 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:26.953726 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5d7edb5f-49eb-43cd-8d1e-450caa223d94 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:26.953726 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5d7edb5f-49eb-43cd-8d1e-450caa223d94 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:26.953726 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5d7edb5f-49eb-43cd-8d1e-450caa223d94 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:27.080420 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-5d7edb5f-49eb-43cd-8d1e-450caa223d94 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:27.088408 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-5d7edb5f-49eb-43cd-8d1e-450caa223d94 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.151637 Jun 22 08:59:27.089380 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 142/255] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:26 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:27.097499 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-aee380d8-840a-49f2-8a94-98b39ca378f5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:27.098134 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-aee380d8-840a-49f2-8a94-98b39ca378f5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:27.101035 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:27.104455 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-aee380d8-840a-49f2-8a94-98b39ca378f5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:27.104862 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-aee380d8-840a-49f2-8a94-98b39ca378f5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:27.105621 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-aee380d8-840a-49f2-8a94-98b39ca378f5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:27.106059 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-aee380d8-840a-49f2-8a94-98b39ca378f5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:27.189736 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9c7f90e3-7f5c-4216-b160-35dc4497a538 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:27.190464 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9c7f90e3-7f5c-4216-b160-35dc4497a538 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:27.197440 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9c7f90e3-7f5c-4216-b160-35dc4497a538 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:27.197987 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9c7f90e3-7f5c-4216-b160-35dc4497a538 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:27.198933 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9c7f90e3-7f5c-4216-b160-35dc4497a538 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:27.199494 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9c7f90e3-7f5c-4216-b160-35dc4497a538 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:27.236935 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-aee380d8-840a-49f2-8a94-98b39ca378f5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:27.245060 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-aee380d8-840a-49f2-8a94-98b39ca378f5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1522 microversion: 2.1 time: 0.152015 Jun 22 08:59:27.245687 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 114/256] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:27 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:27.338853 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9c7f90e3-7f5c-4216-b160-35dc4497a538 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:27.347287 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9c7f90e3-7f5c-4216-b160-35dc4497a538 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:27.348919 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9c7f90e3-7f5c-4216-b160-35dc4497a538 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:27.350074 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9c7f90e3-7f5c-4216-b160-35dc4497a538 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.166357 Jun 22 08:59:27.350759 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 143/257] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:27 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 08:59:27.714111 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f99d261d-5f3a-44e7-8646-1254b6f05816 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:27.714835 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f99d261d-5f3a-44e7-8646-1254b6f05816 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:27.716714 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell0:SELECT=2 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:27.721721 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f99d261d-5f3a-44e7-8646-1254b6f05816 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:27.726543 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f99d261d-5f3a-44e7-8646-1254b6f05816 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:27.726543 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f99d261d-5f3a-44e7-8646-1254b6f05816 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:27.726543 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f99d261d-5f3a-44e7-8646-1254b6f05816 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:27.789223 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-f99d261d-5f3a-44e7-8646-1254b6f05816 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:27.794276 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f99d261d-5f3a-44e7-8646-1254b6f05816 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1218 microversion: 2.1 time: 0.084127 Jun 22 08:59:27.794839 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 115/258] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:27 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:27.944252 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-6a59ea35-3030-46c3-8278-16b6d822c657 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:27.944899 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-6a59ea35-3030-46c3-8278-16b6d822c657 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:27.951291 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6a59ea35-3030-46c3-8278-16b6d822c657 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:27.951745 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6a59ea35-3030-46c3-8278-16b6d822c657 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:27.954374 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6a59ea35-3030-46c3-8278-16b6d822c657 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:27.955099 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6a59ea35-3030-46c3-8278-16b6d822c657 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:28.095823 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-6a59ea35-3030-46c3-8278-16b6d822c657 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:28.103924 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-6a59ea35-3030-46c3-8278-16b6d822c657 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.163843 Jun 22 08:59:28.114621 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 144/259] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:27 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:28.114796 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-d146aa2f-b978-42bd-873f-973ac1961142 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:28.114796 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-d146aa2f-b978-42bd-873f-973ac1961142 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:28.114796 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell0:SELECT=8 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:28.120609 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d146aa2f-b978-42bd-873f-973ac1961142 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:28.120609 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d146aa2f-b978-42bd-873f-973ac1961142 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:28.120609 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d146aa2f-b978-42bd-873f-973ac1961142 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:28.120609 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d146aa2f-b978-42bd-873f-973ac1961142 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:28.258777 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-d146aa2f-b978-42bd-873f-973ac1961142 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:28.263328 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-659196dd-ac96-48a0-9da9-f276a719fcbf tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:28.263665 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-659196dd-ac96-48a0-9da9-f276a719fcbf tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:28.266795 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-d146aa2f-b978-42bd-873f-973ac1961142 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.164311 Jun 22 08:59:28.267582 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 116/260] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:28 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:28.270394 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-659196dd-ac96-48a0-9da9-f276a719fcbf tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:28.270850 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-659196dd-ac96-48a0-9da9-f276a719fcbf tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:28.271614 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-659196dd-ac96-48a0-9da9-f276a719fcbf tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:28.272094 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-659196dd-ac96-48a0-9da9-f276a719fcbf tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:28.367900 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f56503d2-77be-4c36-8c70-07568db6d9a5 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:28.368715 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f56503d2-77be-4c36-8c70-07568db6d9a5 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:28.375516 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f56503d2-77be-4c36-8c70-07568db6d9a5 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:28.376093 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f56503d2-77be-4c36-8c70-07568db6d9a5 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:28.376983 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f56503d2-77be-4c36-8c70-07568db6d9a5 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:28.377704 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f56503d2-77be-4c36-8c70-07568db6d9a5 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:28.409605 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-659196dd-ac96-48a0-9da9-f276a719fcbf tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:28.418432 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-659196dd-ac96-48a0-9da9-f276a719fcbf tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1522 microversion: 2.1 time: 0.159597 Jun 22 08:59:28.419181 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 145/261] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:28 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:28.520762 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-f56503d2-77be-4c36-8c70-07568db6d9a5 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:28.528909 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-f56503d2-77be-4c36-8c70-07568db6d9a5 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:28.531158 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-f56503d2-77be-4c36-8c70-07568db6d9a5 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:28.532317 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f56503d2-77be-4c36-8c70-07568db6d9a5 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.168322 Jun 22 08:59:28.532896 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 117/262] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:28 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 08:59:28.813184 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-0a40f6b1-dd18-49f4-ac67-783de47a0b84 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:28.813817 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-0a40f6b1-dd18-49f4-ac67-783de47a0b84 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:28.819918 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0a40f6b1-dd18-49f4-ac67-783de47a0b84 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:28.820372 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0a40f6b1-dd18-49f4-ac67-783de47a0b84 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:28.821335 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0a40f6b1-dd18-49f4-ac67-783de47a0b84 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:28.821769 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0a40f6b1-dd18-49f4-ac67-783de47a0b84 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:28.883254 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-0a40f6b1-dd18-49f4-ac67-783de47a0b84 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:28.892020 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-0a40f6b1-dd18-49f4-ac67-783de47a0b84 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1218 microversion: 2.1 time: 0.083981 Jun 22 08:59:28.892592 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 146/263] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:28 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:29.122128 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1c0b69f9-4d7d-4468-9541-9c8d585b1cef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:29.122743 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1c0b69f9-4d7d-4468-9541-9c8d585b1cef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:29.129998 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1c0b69f9-4d7d-4468-9541-9c8d585b1cef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:29.130451 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1c0b69f9-4d7d-4468-9541-9c8d585b1cef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:29.131215 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1c0b69f9-4d7d-4468-9541-9c8d585b1cef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:29.131657 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1c0b69f9-4d7d-4468-9541-9c8d585b1cef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:29.264614 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-1c0b69f9-4d7d-4468-9541-9c8d585b1cef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:29.272676 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1c0b69f9-4d7d-4468-9541-9c8d585b1cef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.154329 Jun 22 08:59:29.273373 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 118/264] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:29 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:29.283848 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-fac8fddc-8481-4235-8f44-bb2fe1fc2c6a tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:29.284464 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-fac8fddc-8481-4235-8f44-bb2fe1fc2c6a tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:29.290590 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fac8fddc-8481-4235-8f44-bb2fe1fc2c6a tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:29.294177 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fac8fddc-8481-4235-8f44-bb2fe1fc2c6a tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:29.294177 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fac8fddc-8481-4235-8f44-bb2fe1fc2c6a tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:29.294177 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fac8fddc-8481-4235-8f44-bb2fe1fc2c6a tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:29.423801 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-fac8fddc-8481-4235-8f44-bb2fe1fc2c6a tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:29.431330 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-fac8fddc-8481-4235-8f44-bb2fe1fc2c6a tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.151854 Jun 22 08:59:29.432238 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 147/265] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:29 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:29.435873 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-16a9d090-5416-4e5e-90ca-6fbcdd7a493c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:29.436590 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-16a9d090-5416-4e5e-90ca-6fbcdd7a493c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:29.443238 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-16a9d090-5416-4e5e-90ca-6fbcdd7a493c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:29.443690 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-16a9d090-5416-4e5e-90ca-6fbcdd7a493c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:29.444452 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-16a9d090-5416-4e5e-90ca-6fbcdd7a493c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:29.444947 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-16a9d090-5416-4e5e-90ca-6fbcdd7a493c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:29.552272 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-34f9b7ac-9996-4edd-8425-8938d47d84f9 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:29.553185 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-34f9b7ac-9996-4edd-8425-8938d47d84f9 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:29.562029 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-34f9b7ac-9996-4edd-8425-8938d47d84f9 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:29.562705 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-34f9b7ac-9996-4edd-8425-8938d47d84f9 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:29.563580 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-34f9b7ac-9996-4edd-8425-8938d47d84f9 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:29.564113 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-34f9b7ac-9996-4edd-8425-8938d47d84f9 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:29.583728 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-16a9d090-5416-4e5e-90ca-6fbcdd7a493c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:29.597614 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-16a9d090-5416-4e5e-90ca-6fbcdd7a493c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1522 microversion: 2.1 time: 0.165784 Jun 22 08:59:29.599454 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 119/266] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:29 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:29.723929 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-34f9b7ac-9996-4edd-8425-8938d47d84f9 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:29.731858 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-34f9b7ac-9996-4edd-8425-8938d47d84f9 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:29.734058 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-34f9b7ac-9996-4edd-8425-8938d47d84f9 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:29.735638 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-34f9b7ac-9996-4edd-8425-8938d47d84f9 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.189346 Jun 22 08:59:29.736216 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 148/267] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:29 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 08:59:29.909411 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-87c0bf0d-9eca-4483-a22a-fedd6659f10a tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:29.910012 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-87c0bf0d-9eca-4483-a22a-fedd6659f10a tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:29.916202 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-87c0bf0d-9eca-4483-a22a-fedd6659f10a tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:29.916591 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-87c0bf0d-9eca-4483-a22a-fedd6659f10a tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:29.917383 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-87c0bf0d-9eca-4483-a22a-fedd6659f10a tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:29.917818 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-87c0bf0d-9eca-4483-a22a-fedd6659f10a tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:29.977251 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-87c0bf0d-9eca-4483-a22a-fedd6659f10a tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:29.979381 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=100 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:29.987321 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-87c0bf0d-9eca-4483-a22a-fedd6659f10a tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1218 microversion: 2.1 time: 0.082289 Jun 22 08:59:29.987899 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 120/268] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:29 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:30.291373 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e4fd3046-8e40-4aad-bb29-adabfc04ec9f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:30.291981 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e4fd3046-8e40-4aad-bb29-adabfc04ec9f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:30.298110 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e4fd3046-8e40-4aad-bb29-adabfc04ec9f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:30.298561 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e4fd3046-8e40-4aad-bb29-adabfc04ec9f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:30.299320 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e4fd3046-8e40-4aad-bb29-adabfc04ec9f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:30.299803 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e4fd3046-8e40-4aad-bb29-adabfc04ec9f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:30.450232 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-fab97a41-4f64-43e9-89e4-570fec5cf04e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:30.450922 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-fab97a41-4f64-43e9-89e4-570fec5cf04e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:30.460410 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fab97a41-4f64-43e9-89e4-570fec5cf04e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:30.461126 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fab97a41-4f64-43e9-89e4-570fec5cf04e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:30.461888 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fab97a41-4f64-43e9-89e4-570fec5cf04e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:30.462324 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fab97a41-4f64-43e9-89e4-570fec5cf04e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:30.619863 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-e4fd3046-8e40-4aad-bb29-adabfc04ec9f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:30.628616 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e4fd3046-8e40-4aad-bb29-adabfc04ec9f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.341035 Jun 22 08:59:30.629472 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 149/269] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:30 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:30.634142 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7e39bc97-918a-4b54-857b-f4dfb7f21f4a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:30.634543 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7e39bc97-918a-4b54-857b-f4dfb7f21f4a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:30.640875 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7e39bc97-918a-4b54-857b-f4dfb7f21f4a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:30.641531 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7e39bc97-918a-4b54-857b-f4dfb7f21f4a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:30.642527 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7e39bc97-918a-4b54-857b-f4dfb7f21f4a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:30.643106 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7e39bc97-918a-4b54-857b-f4dfb7f21f4a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:30.650200 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-fab97a41-4f64-43e9-89e4-570fec5cf04e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:30.658098 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-fab97a41-4f64-43e9-89e4-570fec5cf04e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.212028 Jun 22 08:59:30.658996 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 121/270] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:30 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:30.754332 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-971d5b47-e750-4b89-9782-9035c3be6d82 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:30.755024 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-971d5b47-e750-4b89-9782-9035c3be6d82 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:30.761170 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-971d5b47-e750-4b89-9782-9035c3be6d82 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:30.761607 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-971d5b47-e750-4b89-9782-9035c3be6d82 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:30.762378 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-971d5b47-e750-4b89-9782-9035c3be6d82 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:30.762815 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-971d5b47-e750-4b89-9782-9035c3be6d82 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:30.774751 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7e39bc97-918a-4b54-857b-f4dfb7f21f4a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:30.782374 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7e39bc97-918a-4b54-857b-f4dfb7f21f4a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1522 microversion: 2.1 time: 0.151873 Jun 22 08:59:30.782850 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 150/271] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:30 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:30.891949 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-971d5b47-e750-4b89-9782-9035c3be6d82 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:30.899920 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-971d5b47-e750-4b89-9782-9035c3be6d82 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:30.901473 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-971d5b47-e750-4b89-9782-9035c3be6d82 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:30.902577 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-971d5b47-e750-4b89-9782-9035c3be6d82 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.152394 Jun 22 08:59:30.903132 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 122/272] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:30 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 08:59:31.005111 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-56f3fad0-2541-48db-bef1-f57554d6fe09 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:31.005725 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-56f3fad0-2541-48db-bef1-f57554d6fe09 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:31.011703 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-56f3fad0-2541-48db-bef1-f57554d6fe09 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:31.012157 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-56f3fad0-2541-48db-bef1-f57554d6fe09 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:31.012949 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-56f3fad0-2541-48db-bef1-f57554d6fe09 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:31.013419 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-56f3fad0-2541-48db-bef1-f57554d6fe09 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:31.077712 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-56f3fad0-2541-48db-bef1-f57554d6fe09 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:31.085226 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-56f3fad0-2541-48db-bef1-f57554d6fe09 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1218 microversion: 2.1 time: 0.083941 Jun 22 08:59:31.085825 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 151/273] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:31 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:31.646178 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6b436b26-98a5-4582-9d53-8b9e9246cbd8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:31.646796 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-6b436b26-98a5-4582-9d53-8b9e9246cbd8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:31.653380 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6b436b26-98a5-4582-9d53-8b9e9246cbd8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:31.653820 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6b436b26-98a5-4582-9d53-8b9e9246cbd8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:31.654701 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6b436b26-98a5-4582-9d53-8b9e9246cbd8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:31.655858 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6b436b26-98a5-4582-9d53-8b9e9246cbd8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:31.675365 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-77c1a368-3a49-497c-a7f3-ab552428b00e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:31.675977 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-77c1a368-3a49-497c-a7f3-ab552428b00e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:31.681973 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-77c1a368-3a49-497c-a7f3-ab552428b00e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:31.682421 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-77c1a368-3a49-497c-a7f3-ab552428b00e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:31.683190 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-77c1a368-3a49-497c-a7f3-ab552428b00e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:31.683641 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-77c1a368-3a49-497c-a7f3-ab552428b00e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:32.071880 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-6b436b26-98a5-4582-9d53-8b9e9246cbd8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:32.080221 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-6b436b26-98a5-4582-9d53-8b9e9246cbd8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1364 microversion: 2.1 time: 0.437770 Jun 22 08:59:32.080912 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 123/274] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:31 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1364 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:32.083554 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-77c1a368-3a49-497c-a7f3-ab552428b00e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:32.095511 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b037d366-c7c1-4bba-891a-f9681fc75df2 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:32.096639 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-b037d366-c7c1-4bba-891a-f9681fc75df2 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:32.117521 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-77c1a368-3a49-497c-a7f3-ab552428b00e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.429838 Jun 22 08:59:32.117683 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b037d366-c7c1-4bba-891a-f9681fc75df2 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:32.117683 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b037d366-c7c1-4bba-891a-f9681fc75df2 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:32.117852 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 152/275] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:31 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:32.117923 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b037d366-c7c1-4bba-891a-f9681fc75df2 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:32.117923 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b037d366-c7c1-4bba-891a-f9681fc75df2 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:32.122360 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-1aa9c0f0-9d34-4738-af22-0db28ef12f86 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:32.127275 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-1aa9c0f0-9d34-4738-af22-0db28ef12f86 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:32.140050 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1aa9c0f0-9d34-4738-af22-0db28ef12f86 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:32.140419 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1aa9c0f0-9d34-4738-af22-0db28ef12f86 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:32.141408 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1aa9c0f0-9d34-4738-af22-0db28ef12f86 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:32.144900 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1aa9c0f0-9d34-4738-af22-0db28ef12f86 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:32.347265 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-1aa9c0f0-9d34-4738-af22-0db28ef12f86 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:32.353179 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-b037d366-c7c1-4bba-891a-f9681fc75df2 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:32.355405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-1aa9c0f0-9d34-4738-af22-0db28ef12f86 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:32.356952 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-1aa9c0f0-9d34-4738-af22-0db28ef12f86 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:32.358074 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-1aa9c0f0-9d34-4738-af22-0db28ef12f86 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.251770 Jun 22 08:59:32.358698 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 153/276] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:32 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:59:32.362597 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-b037d366-c7c1-4bba-891a-f9681fc75df2 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1522 microversion: 2.1 time: 0.279929 Jun 22 08:59:32.363361 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 124/277] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:32 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:32.364435 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7d036b4e-aae8-425f-8a04-4911fccd0c9c tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:32.365117 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7d036b4e-aae8-425f-8a04-4911fccd0c9c tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:32.371459 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7d036b4e-aae8-425f-8a04-4911fccd0c9c tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:32.371850 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7d036b4e-aae8-425f-8a04-4911fccd0c9c tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:32.372617 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7d036b4e-aae8-425f-8a04-4911fccd0c9c tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:32.373086 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7d036b4e-aae8-425f-8a04-4911fccd0c9c tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:32.391544 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:32.434476 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7d036b4e-aae8-425f-8a04-4911fccd0c9c tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:32.442260 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7d036b4e-aae8-425f-8a04-4911fccd0c9c tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1210 microversion: 2.1 time: 0.082540 Jun 22 08:59:32.442827 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 154/278] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:32 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1210 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:32.741565 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-dbf27f9b-a23d-4ebf-bf03-8ca4bab45c1f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1171513306", "imageRef": "c24d36a8-7909-4174-9b12-42c8d76647ac", "flavorRef": "452", "networks": [{"uuid": "9cebc870-2569-4829-b107-df670b5ca5e5"}]}} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:59:32.794594 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.network.neutron [None req-dbf27f9b-a23d-4ebf-bf03-8ca4bab45c1f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] validate_networks() for [('9cebc870-2569-4829-b107-df670b5ca5e5', None, None, None, None, None)] {{(pid=118024) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 08:59:32.828952 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-19776e5f-b0b6-4633-b0f3-23ffb8776f91 req-c5ff3204-d592-4dcf-834b-f0355739bd5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10", "name": "network-vif-plugged", "status": "completed", "tag": "9678ec97-a7d2-4f9c-aa09-000750551309"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:59:32.839974 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-19776e5f-b0b6-4633-b0f3-23ffb8776f91 req-c5ff3204-d592-4dcf-834b-f0355739bd5f service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:32.840424 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-19776e5f-b0b6-4633-b0f3-23ffb8776f91 req-c5ff3204-d592-4dcf-834b-f0355739bd5f service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:32.853540 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-19776e5f-b0b6-4633-b0f3-23ffb8776f91 req-c5ff3204-d592-4dcf-834b-f0355739bd5f service nova] Creating event network-vif-plugged:9678ec97-a7d2-4f9c-aa09-000750551309 for instance cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 on hv-cinder-84599 Jun 22 08:59:32.859644 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-19776e5f-b0b6-4633-b0f3-23ffb8776f91 req-c5ff3204-d592-4dcf-834b-f0355739bd5f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035117 Jun 22 08:59:32.860245 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 155/279] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 08:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 08:59:33.098018 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2fa1f34c-a6c1-435d-8da9-9fbd1454270c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:33.098717 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2fa1f34c-a6c1-435d-8da9-9fbd1454270c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:33.105290 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2fa1f34c-a6c1-435d-8da9-9fbd1454270c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:33.105741 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2fa1f34c-a6c1-435d-8da9-9fbd1454270c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:33.106508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2fa1f34c-a6c1-435d-8da9-9fbd1454270c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:33.106945 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2fa1f34c-a6c1-435d-8da9-9fbd1454270c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:33.164402 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-dbf27f9b-a23d-4ebf-bf03-8ca4bab45c1f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Flavor limits 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 08:59:33.165102 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-dbf27f9b-a23d-4ebf-bf03-8ca4bab45c1f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Image limits 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 08:59:33.165579 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-dbf27f9b-a23d-4ebf-bf03-8ca4bab45c1f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Flavor pref 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 08:59:33.166070 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-dbf27f9b-a23d-4ebf-bf03-8ca4bab45c1f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Image pref 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 08:59:33.166512 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-dbf27f9b-a23d-4ebf-bf03-8ca4bab45c1f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 08:59:33.176638 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dbf27f9b-a23d-4ebf-bf03-8ca4bab45c1f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:33.177122 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dbf27f9b-a23d-4ebf-bf03-8ca4bab45c1f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:33.177921 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dbf27f9b-a23d-4ebf-bf03-8ca4bab45c1f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:33.178357 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dbf27f9b-a23d-4ebf-bf03-8ca4bab45c1f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:33.204794 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.quota [None req-dbf27f9b-a23d-4ebf-bf03-8ca4bab45c1f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Getting quotas for project 8ce1a6d223c14059b3ea7e07bfa1f577. Resources: {'cores', 'instances', 'ram'} {{(pid=118024) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 08:59:33.216284 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.quota [None req-dbf27f9b-a23d-4ebf-bf03-8ca4bab45c1f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Getting quotas for user 6fb1f75729d741928453fea5345938a2 and project 8ce1a6d223c14059b3ea7e07bfa1f577. Resources: {'cores', 'instances', 'ram'} {{(pid=118024) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 08:59:33.228434 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-dbf27f9b-a23d-4ebf-bf03-8ca4bab45c1f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Going to run 1 instances... {{(pid=118024) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 08:59:33.230593 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-dbf27f9b-a23d-4ebf-bf03-8ca4bab45c1f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c24d36a8-7909-4174-9b12-42c8d76647ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118024) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 08:59:33.255610 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-2fa1f34c-a6c1-435d-8da9-9fbd1454270c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:33.263144 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2fa1f34c-a6c1-435d-8da9-9fbd1454270c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1549 microversion: 2.1 time: 0.169683 Jun 22 08:59:33.267678 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 156/280] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:33 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1549 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:33.287115 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-b0b58d32-67d2-4486-ab5b-6cfbc3f1d30d tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:33.287743 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-b0b58d32-67d2-4486-ab5b-6cfbc3f1d30d tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:33.294706 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b0b58d32-67d2-4486-ab5b-6cfbc3f1d30d tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:33.304551 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b0b58d32-67d2-4486-ab5b-6cfbc3f1d30d tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:33.304551 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b0b58d32-67d2-4486-ab5b-6cfbc3f1d30d tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:33.304551 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b0b58d32-67d2-4486-ab5b-6cfbc3f1d30d tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:33.379050 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-dbf27f9b-a23d-4ebf-bf03-8ca4bab45c1f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.640943 Jun 22 08:59:33.381105 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 125/281] 10.222.0.16 () {60 vars in 1146 bytes} [Wed Jun 22 08:59:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 08:59:33.393736 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b850c59a-2392-4ee8-bc60-5b5fc461340b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:33.394468 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-b850c59a-2392-4ee8-bc60-5b5fc461340b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:33.408583 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b850c59a-2392-4ee8-bc60-5b5fc461340b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:33.413702 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b850c59a-2392-4ee8-bc60-5b5fc461340b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:33.414802 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b850c59a-2392-4ee8-bc60-5b5fc461340b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:33.415346 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b850c59a-2392-4ee8-bc60-5b5fc461340b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:33.595614 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-b0b58d32-67d2-4486-ab5b-6cfbc3f1d30d tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:33.604166 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-b0b58d32-67d2-4486-ab5b-6cfbc3f1d30d tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.331560 Jun 22 08:59:33.616641 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 157/282] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:33 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:33.621687 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c91e730c-f872-47e5-a5c3-68c658df5e64 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:33.622291 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c91e730c-f872-47e5-a5c3-68c658df5e64 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:33.630603 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c91e730c-f872-47e5-a5c3-68c658df5e64 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:33.631170 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c91e730c-f872-47e5-a5c3-68c658df5e64 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:33.631913 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c91e730c-f872-47e5-a5c3-68c658df5e64 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:33.632336 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c91e730c-f872-47e5-a5c3-68c658df5e64 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:33.668269 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-b850c59a-2392-4ee8-bc60-5b5fc461340b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.285764 Jun 22 08:59:33.669310 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 126/283] 10.222.0.16 () {58 vars in 1274 bytes} [Wed Jun 22 08:59:33 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-interface => generated 284 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:59:33.682017 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3a74179c-1b9d-4f3f-b410-31ef7a8c16c4 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:33.682017 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3a74179c-1b9d-4f3f-b410-31ef7a8c16c4 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:33.690073 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3a74179c-1b9d-4f3f-b410-31ef7a8c16c4 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:33.690532 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3a74179c-1b9d-4f3f-b410-31ef7a8c16c4 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:33.691312 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3a74179c-1b9d-4f3f-b410-31ef7a8c16c4 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:33.691753 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3a74179c-1b9d-4f3f-b410-31ef7a8c16c4 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:33.834588 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c91e730c-f872-47e5-a5c3-68c658df5e64 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:33.847819 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c91e730c-f872-47e5-a5c3-68c658df5e64 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1522 microversion: 2.1 time: 0.230215 Jun 22 08:59:33.848584 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 158/284] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:33 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:33.863643 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e280c7a2-6ac7-4f0d-942b-6a6c0525bc9d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:33.866224 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e280c7a2-6ac7-4f0d-942b-6a6c0525bc9d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:33.879227 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3a74179c-1b9d-4f3f-b410-31ef7a8c16c4 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:33.889280 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3a74179c-1b9d-4f3f-b410-31ef7a8c16c4 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:33.890951 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3a74179c-1b9d-4f3f-b410-31ef7a8c16c4 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:33.892180 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3a74179c-1b9d-4f3f-b410-31ef7a8c16c4 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.221860 Jun 22 08:59:33.892971 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 127/285] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:33 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:59:33.900838 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-bef1c91b-d347-462e-a261-dd0a057e5765 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:33.900838 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-bef1c91b-d347-462e-a261-dd0a057e5765 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:33.909890 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bef1c91b-d347-462e-a261-dd0a057e5765 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:33.910357 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bef1c91b-d347-462e-a261-dd0a057e5765 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:33.911380 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bef1c91b-d347-462e-a261-dd0a057e5765 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:33.911897 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bef1c91b-d347-462e-a261-dd0a057e5765 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:33.940142 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-e280c7a2-6ac7-4f0d-942b-6a6c0525bc9d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:33.948840 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e280c7a2-6ac7-4f0d-942b-6a6c0525bc9d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1219 microversion: 2.1 time: 0.088907 Jun 22 08:59:33.950276 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 159/286] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:33 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:33.990143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-bef1c91b-d347-462e-a261-dd0a057e5765 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:34.004073 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-bef1c91b-d347-462e-a261-dd0a057e5765 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1266 microversion: 2.1 time: 0.105953 Jun 22 08:59:34.004073 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 128/287] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:33 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:34.622023 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c0bc1390-e079-4b28-8a97-063ce0743ef7 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:34.622659 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c0bc1390-e079-4b28-8a97-063ce0743ef7 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:34.629971 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c0bc1390-e079-4b28-8a97-063ce0743ef7 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:34.630575 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c0bc1390-e079-4b28-8a97-063ce0743ef7 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:34.631424 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c0bc1390-e079-4b28-8a97-063ce0743ef7 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:34.632051 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c0bc1390-e079-4b28-8a97-063ce0743ef7 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:34.765318 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c0bc1390-e079-4b28-8a97-063ce0743ef7 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:34.783287 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c0bc1390-e079-4b28-8a97-063ce0743ef7 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.165184 Jun 22 08:59:34.783871 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 160/288] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:34 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:34.865447 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-69b304da-6292-4a1b-bead-0e1e3cbeb01a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:34.866082 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-69b304da-6292-4a1b-bead-0e1e3cbeb01a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:34.873066 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-69b304da-6292-4a1b-bead-0e1e3cbeb01a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:34.873521 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-69b304da-6292-4a1b-bead-0e1e3cbeb01a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:34.874928 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-69b304da-6292-4a1b-bead-0e1e3cbeb01a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:34.875219 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-69b304da-6292-4a1b-bead-0e1e3cbeb01a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:34.910547 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-409cd9d5-075f-41c3-be12-ab09b4e56951 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:34.911220 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-409cd9d5-075f-41c3-be12-ab09b4e56951 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:34.917722 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-409cd9d5-075f-41c3-be12-ab09b4e56951 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:34.918186 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-409cd9d5-075f-41c3-be12-ab09b4e56951 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:34.918960 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-409cd9d5-075f-41c3-be12-ab09b4e56951 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:34.919581 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-409cd9d5-075f-41c3-be12-ab09b4e56951 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:35.065847 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-69b304da-6292-4a1b-bead-0e1e3cbeb01a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:35.074064 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-69b304da-6292-4a1b-bead-0e1e3cbeb01a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1522 microversion: 2.1 time: 0.212586 Jun 22 08:59:35.083684 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 129/289] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:34 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:35.087013 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-56b81bcc-db68-4469-9faf-c7349e292007 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:35.087892 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-56b81bcc-db68-4469-9faf-c7349e292007 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:35.091122 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-409cd9d5-075f-41c3-be12-ab09b4e56951 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:35.096041 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-56b81bcc-db68-4469-9faf-c7349e292007 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:35.096688 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-56b81bcc-db68-4469-9faf-c7349e292007 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:35.097499 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-56b81bcc-db68-4469-9faf-c7349e292007 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:35.098326 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-56b81bcc-db68-4469-9faf-c7349e292007 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:35.100713 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-409cd9d5-075f-41c3-be12-ab09b4e56951 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:35.103555 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-409cd9d5-075f-41c3-be12-ab09b4e56951 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:35.103678 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-409cd9d5-075f-41c3-be12-ab09b4e56951 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.197467 Jun 22 08:59:35.104163 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 161/290] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:34 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 08:59:35.110089 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-21973459-c797-42e0-beab-8054423f54c5 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:35.110881 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-21973459-c797-42e0-beab-8054423f54c5 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:35.117275 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-21973459-c797-42e0-beab-8054423f54c5 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:35.117906 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-21973459-c797-42e0-beab-8054423f54c5 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:35.118836 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-21973459-c797-42e0-beab-8054423f54c5 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:35.119454 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-21973459-c797-42e0-beab-8054423f54c5 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:35.171264 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-56b81bcc-db68-4469-9faf-c7349e292007 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:35.181384 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-56b81bcc-db68-4469-9faf-c7349e292007 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1223 microversion: 2.1 time: 0.098711 Jun 22 08:59:35.190167 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 130/291] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:35 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1223 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:35.205880 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-21973459-c797-42e0-beab-8054423f54c5 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:35.212141 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-21973459-c797-42e0-beab-8054423f54c5 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1266 microversion: 2.1 time: 0.106916 Jun 22 08:59:35.212713 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 162/292] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:35 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:35.215258 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [req-a6af9ba1-ede7-43d0-a376-9dbe682a3784 req-983cae18-2a2d-4be7-b7f8-e850cd0b2c42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b84e6922-9b60-4a6d-8836-4b07ef206590", "tag": "e4f8b1de-c427-4428-a8a5-28fa99c60cba"}]} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:59:35.224912 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-a6af9ba1-ede7-43d0-a376-9dbe682a3784 req-983cae18-2a2d-4be7-b7f8-e850cd0b2c42 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:35.225358 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-a6af9ba1-ede7-43d0-a376-9dbe682a3784 req-983cae18-2a2d-4be7-b7f8-e850cd0b2c42 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:35.237219 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.compute.server_external_events [req-a6af9ba1-ede7-43d0-a376-9dbe682a3784 req-983cae18-2a2d-4be7-b7f8-e850cd0b2c42 service nova] Creating event network-changed:e4f8b1de-c427-4428-a8a5-28fa99c60cba for instance b84e6922-9b60-4a6d-8836-4b07ef206590 on hv-cinder-84599 Jun 22 08:59:35.242151 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [req-a6af9ba1-ede7-43d0-a376-9dbe682a3784 req-983cae18-2a2d-4be7-b7f8-e850cd0b2c42 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032235 Jun 22 08:59:35.242735 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 131/293] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 08:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 08:59:35.800307 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-ce380bf0-9b5c-4d6d-935f-cbf41560ef8d tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:35.800960 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-ce380bf0-9b5c-4d6d-935f-cbf41560ef8d tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:35.807051 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ce380bf0-9b5c-4d6d-935f-cbf41560ef8d tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:35.807501 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ce380bf0-9b5c-4d6d-935f-cbf41560ef8d tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:35.808259 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ce380bf0-9b5c-4d6d-935f-cbf41560ef8d tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:35.808698 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ce380bf0-9b5c-4d6d-935f-cbf41560ef8d tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:35.944039 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-ce380bf0-9b5c-4d6d-935f-cbf41560ef8d tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:35.952812 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-ce380bf0-9b5c-4d6d-935f-cbf41560ef8d tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.157191 Jun 22 08:59:35.953504 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 163/294] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:35 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:36.093125 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-36decaf2-4faa-4a1c-a990-c8bdb8451b04 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:36.094144 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-36decaf2-4faa-4a1c-a990-c8bdb8451b04 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:36.100642 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-36decaf2-4faa-4a1c-a990-c8bdb8451b04 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:36.101127 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-36decaf2-4faa-4a1c-a990-c8bdb8451b04 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:36.101893 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-36decaf2-4faa-4a1c-a990-c8bdb8451b04 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:36.102327 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-36decaf2-4faa-4a1c-a990-c8bdb8451b04 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:36.122085 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a66d34bb-16f6-49df-967a-a85ddda0b59c tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:36.122352 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-a66d34bb-16f6-49df-967a-a85ddda0b59c tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:36.129055 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a66d34bb-16f6-49df-967a-a85ddda0b59c tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:36.129517 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a66d34bb-16f6-49df-967a-a85ddda0b59c tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:36.130309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a66d34bb-16f6-49df-967a-a85ddda0b59c tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:36.130875 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a66d34bb-16f6-49df-967a-a85ddda0b59c tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:36.306747 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-36decaf2-4faa-4a1c-a990-c8bdb8451b04 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:36.316681 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-36decaf2-4faa-4a1c-a990-c8bdb8451b04 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1522 microversion: 2.1 time: 0.228935 Jun 22 08:59:36.317456 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 132/295] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:36 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:36.322006 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-a66d34bb-16f6-49df-967a-a85ddda0b59c tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:36.322583 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3d0c37b3-86b4-4b56-8d7c-59d4a0bb1624 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:36.323306 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3d0c37b3-86b4-4b56-8d7c-59d4a0bb1624 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:36.331604 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3d0c37b3-86b4-4b56-8d7c-59d4a0bb1624 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:36.332129 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3d0c37b3-86b4-4b56-8d7c-59d4a0bb1624 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:36.333027 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3d0c37b3-86b4-4b56-8d7c-59d4a0bb1624 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:36.333279 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-a66d34bb-16f6-49df-967a-a85ddda0b59c tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:36.333577 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3d0c37b3-86b4-4b56-8d7c-59d4a0bb1624 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:36.334797 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-a66d34bb-16f6-49df-967a-a85ddda0b59c tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:36.335917 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a66d34bb-16f6-49df-967a-a85ddda0b59c tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.218152 Jun 22 08:59:36.336464 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 164/296] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:36 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 08:59:36.340997 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a5b9c943-dfab-4887-b9fa-b5974c0db3b0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:36.341601 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-a5b9c943-dfab-4887-b9fa-b5974c0db3b0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:36.348441 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a5b9c943-dfab-4887-b9fa-b5974c0db3b0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:36.348619 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a5b9c943-dfab-4887-b9fa-b5974c0db3b0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:36.349597 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a5b9c943-dfab-4887-b9fa-b5974c0db3b0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:36.350186 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a5b9c943-dfab-4887-b9fa-b5974c0db3b0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:36.430676 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3d0c37b3-86b4-4b56-8d7c-59d4a0bb1624 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:36.432488 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-a5b9c943-dfab-4887-b9fa-b5974c0db3b0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:36.439052 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3d0c37b3-86b4-4b56-8d7c-59d4a0bb1624 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1223 microversion: 2.1 time: 0.120353 Jun 22 08:59:36.440123 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 133/297] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:36 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1223 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:36.441796 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a5b9c943-dfab-4887-b9fa-b5974c0db3b0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1266 microversion: 2.1 time: 0.104139 Jun 22 08:59:36.442550 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 165/298] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:36 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:36.969506 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b9ed3923-6c5b-4b4d-abaf-05d6a7075418 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:36.970310 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-b9ed3923-6c5b-4b4d-abaf-05d6a7075418 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:36.977025 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b9ed3923-6c5b-4b4d-abaf-05d6a7075418 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:36.977473 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b9ed3923-6c5b-4b4d-abaf-05d6a7075418 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:36.978233 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b9ed3923-6c5b-4b4d-abaf-05d6a7075418 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:36.978664 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b9ed3923-6c5b-4b4d-abaf-05d6a7075418 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:37.119275 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-b9ed3923-6c5b-4b4d-abaf-05d6a7075418 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:37.126917 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-b9ed3923-6c5b-4b4d-abaf-05d6a7075418 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.161525 Jun 22 08:59:37.127479 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 134/299] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:36 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:37.333929 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-375e9af7-b285-4c9f-99c7-467d6fbcd682 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:37.334540 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-375e9af7-b285-4c9f-99c7-467d6fbcd682 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:37.340805 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-375e9af7-b285-4c9f-99c7-467d6fbcd682 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:37.341250 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-375e9af7-b285-4c9f-99c7-467d6fbcd682 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:37.342008 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-375e9af7-b285-4c9f-99c7-467d6fbcd682 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:37.343034 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-375e9af7-b285-4c9f-99c7-467d6fbcd682 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:37.353879 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ccd7960d-11b2-4769-8bbb-314f9b77d0dd tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:37.354492 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ccd7960d-11b2-4769-8bbb-314f9b77d0dd tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:37.361381 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ccd7960d-11b2-4769-8bbb-314f9b77d0dd tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:37.361832 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ccd7960d-11b2-4769-8bbb-314f9b77d0dd tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:37.362594 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ccd7960d-11b2-4769-8bbb-314f9b77d0dd tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:37.363034 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ccd7960d-11b2-4769-8bbb-314f9b77d0dd tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:37.540906 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-375e9af7-b285-4c9f-99c7-467d6fbcd682 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:37.548467 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-375e9af7-b285-4c9f-99c7-467d6fbcd682 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1522 microversion: 2.1 time: 0.218373 Jun 22 08:59:37.549061 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 166/300] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:37 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:37.551965 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ccd7960d-11b2-4769-8bbb-314f9b77d0dd tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:37.553835 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-fa5eb9ca-fa17-4188-9c8a-807f695f5c7e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:37.554695 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-fa5eb9ca-fa17-4188-9c8a-807f695f5c7e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:37.560390 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ccd7960d-11b2-4769-8bbb-314f9b77d0dd tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:37.560852 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fa5eb9ca-fa17-4188-9c8a-807f695f5c7e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:37.561308 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fa5eb9ca-fa17-4188-9c8a-807f695f5c7e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:37.562080 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fa5eb9ca-fa17-4188-9c8a-807f695f5c7e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:37.562181 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ccd7960d-11b2-4769-8bbb-314f9b77d0dd tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:37.562523 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fa5eb9ca-fa17-4188-9c8a-807f695f5c7e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:37.563540 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ccd7960d-11b2-4769-8bbb-314f9b77d0dd tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.213523 Jun 22 08:59:37.564106 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 135/301] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:37 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 08:59:37.568722 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b602f7da-d96c-4d9c-9a7c-e0c431c8143e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:37.569347 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-b602f7da-d96c-4d9c-9a7c-e0c431c8143e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:37.575248 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b602f7da-d96c-4d9c-9a7c-e0c431c8143e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:37.575700 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b602f7da-d96c-4d9c-9a7c-e0c431c8143e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:37.576449 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b602f7da-d96c-4d9c-9a7c-e0c431c8143e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:37.577482 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b602f7da-d96c-4d9c-9a7c-e0c431c8143e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:37.625768 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-fa5eb9ca-fa17-4188-9c8a-807f695f5c7e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:37.633219 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-fa5eb9ca-fa17-4188-9c8a-807f695f5c7e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1223 microversion: 2.1 time: 0.082841 Jun 22 08:59:37.633791 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 167/302] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:37 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:37.651063 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-b602f7da-d96c-4d9c-9a7c-e0c431c8143e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:37.659405 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-b602f7da-d96c-4d9c-9a7c-e0c431c8143e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1266 microversion: 2.1 time: 0.094352 Jun 22 08:59:37.659953 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 136/303] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:37 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:38.143837 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-11c77a46-e312-4b92-b95f-849c77003d07 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:38.144450 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-11c77a46-e312-4b92-b95f-849c77003d07 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:38.150573 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-11c77a46-e312-4b92-b95f-849c77003d07 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:38.151022 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-11c77a46-e312-4b92-b95f-849c77003d07 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:38.151802 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-11c77a46-e312-4b92-b95f-849c77003d07 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:38.152241 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-11c77a46-e312-4b92-b95f-849c77003d07 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:38.279010 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-11c77a46-e312-4b92-b95f-849c77003d07 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:38.286447 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-11c77a46-e312-4b92-b95f-849c77003d07 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.146490 Jun 22 08:59:38.287017 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 168/304] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:38 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:38.565856 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-fc5baa5a-153a-471c-9447-a6abb87640bd tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:38.566480 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-fc5baa5a-153a-471c-9447-a6abb87640bd tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:38.573184 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fc5baa5a-153a-471c-9447-a6abb87640bd tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:38.573639 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fc5baa5a-153a-471c-9447-a6abb87640bd tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:38.574406 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fc5baa5a-153a-471c-9447-a6abb87640bd tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:38.574850 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fc5baa5a-153a-471c-9447-a6abb87640bd tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:38.581534 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7b0d5c4a-7eef-498f-a5a5-31f06969cf73 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:38.582148 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7b0d5c4a-7eef-498f-a5a5-31f06969cf73 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:38.588034 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7b0d5c4a-7eef-498f-a5a5-31f06969cf73 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:38.588483 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7b0d5c4a-7eef-498f-a5a5-31f06969cf73 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:38.589346 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7b0d5c4a-7eef-498f-a5a5-31f06969cf73 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:38.589787 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7b0d5c4a-7eef-498f-a5a5-31f06969cf73 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:38.786753 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-fc5baa5a-153a-471c-9447-a6abb87640bd tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:38.790470 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7b0d5c4a-7eef-498f-a5a5-31f06969cf73 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:38.794472 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-fc5baa5a-153a-471c-9447-a6abb87640bd tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1522 microversion: 2.1 time: 0.232521 Jun 22 08:59:38.795043 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 137/305] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:38 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:38.799488 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7b0d5c4a-7eef-498f-a5a5-31f06969cf73 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:38.800439 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-accf729e-7013-4952-8827-3a2e7d31bf18 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:38.801208 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7b0d5c4a-7eef-498f-a5a5-31f06969cf73 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:38.801322 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-accf729e-7013-4952-8827-3a2e7d31bf18 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:38.802321 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7b0d5c4a-7eef-498f-a5a5-31f06969cf73 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.224671 Jun 22 08:59:38.804370 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 169/306] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:38 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 08:59:38.807632 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a2ec1ec0-ca6e-4f0f-9c06-4c3523248856 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:38.808080 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-accf729e-7013-4952-8827-3a2e7d31bf18 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:38.808235 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-a2ec1ec0-ca6e-4f0f-9c06-4c3523248856 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:38.808536 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-accf729e-7013-4952-8827-3a2e7d31bf18 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:38.809591 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-accf729e-7013-4952-8827-3a2e7d31bf18 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:38.810033 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-accf729e-7013-4952-8827-3a2e7d31bf18 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:38.814573 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a2ec1ec0-ca6e-4f0f-9c06-4c3523248856 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:38.815029 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a2ec1ec0-ca6e-4f0f-9c06-4c3523248856 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:38.815799 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a2ec1ec0-ca6e-4f0f-9c06-4c3523248856 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:38.816255 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a2ec1ec0-ca6e-4f0f-9c06-4c3523248856 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:38.895418 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-accf729e-7013-4952-8827-3a2e7d31bf18 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:38.897081 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-a2ec1ec0-ca6e-4f0f-9c06-4c3523248856 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:38.903241 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-accf729e-7013-4952-8827-3a2e7d31bf18 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1223 microversion: 2.1 time: 0.106344 Jun 22 08:59:38.903820 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 138/307] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:38 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1223 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:38.904452 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a2ec1ec0-ca6e-4f0f-9c06-4c3523248856 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1266 microversion: 2.1 time: 0.100353 Jun 22 08:59:38.905768 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 170/308] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:38 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:39.303947 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a902bfef-f0d2-459d-9b95-fd48b7c800f8 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:39.304554 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a902bfef-f0d2-459d-9b95-fd48b7c800f8 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:39.311558 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a902bfef-f0d2-459d-9b95-fd48b7c800f8 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:39.312004 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a902bfef-f0d2-459d-9b95-fd48b7c800f8 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:39.312763 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a902bfef-f0d2-459d-9b95-fd48b7c800f8 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:39.313213 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a902bfef-f0d2-459d-9b95-fd48b7c800f8 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:39.315954 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=100 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:39.440709 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-a902bfef-f0d2-459d-9b95-fd48b7c800f8 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:39.448066 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a902bfef-f0d2-459d-9b95-fd48b7c800f8 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.148030 Jun 22 08:59:39.448623 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 139/309] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:39 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:39.813376 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c043143d-222f-4cee-9ee4-5eb614b3d8b3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:39.813983 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c043143d-222f-4cee-9ee4-5eb614b3d8b3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:39.816012 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=100 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:39.820874 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c043143d-222f-4cee-9ee4-5eb614b3d8b3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:39.821115 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3d5a8cd0-44cf-4425-8b3b-0a72a4674d36 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:39.821530 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c043143d-222f-4cee-9ee4-5eb614b3d8b3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:39.821759 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3d5a8cd0-44cf-4425-8b3b-0a72a4674d36 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:39.822066 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c043143d-222f-4cee-9ee4-5eb614b3d8b3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:39.822500 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c043143d-222f-4cee-9ee4-5eb614b3d8b3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:39.828239 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3d5a8cd0-44cf-4425-8b3b-0a72a4674d36 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:39.832335 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3d5a8cd0-44cf-4425-8b3b-0a72a4674d36 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:39.832335 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3d5a8cd0-44cf-4425-8b3b-0a72a4674d36 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:39.832335 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3d5a8cd0-44cf-4425-8b3b-0a72a4674d36 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:40.019608 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c043143d-222f-4cee-9ee4-5eb614b3d8b3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:40.022542 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3d5a8cd0-44cf-4425-8b3b-0a72a4674d36 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:40.027189 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c043143d-222f-4cee-9ee4-5eb614b3d8b3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1522 microversion: 2.1 time: 0.218596 Jun 22 08:59:40.027756 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 171/310] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:39 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:40.030682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3d5a8cd0-44cf-4425-8b3b-0a72a4674d36 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:40.032195 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3d5a8cd0-44cf-4425-8b3b-0a72a4674d36 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:40.032324 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2adf0c08-2c45-4d60-92a6-969dc22857ff tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:40.032960 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2adf0c08-2c45-4d60-92a6-969dc22857ff tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:40.033333 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3d5a8cd0-44cf-4425-8b3b-0a72a4674d36 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.216050 Jun 22 08:59:40.037095 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 140/311] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:39 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:59:40.038246 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1ac247ec-560f-41ef-96cb-781243e8e1ba tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:40.038988 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1ac247ec-560f-41ef-96cb-781243e8e1ba tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:40.039687 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2adf0c08-2c45-4d60-92a6-969dc22857ff tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:40.040136 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2adf0c08-2c45-4d60-92a6-969dc22857ff tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:40.040927 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2adf0c08-2c45-4d60-92a6-969dc22857ff tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:40.041361 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2adf0c08-2c45-4d60-92a6-969dc22857ff tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:40.044864 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1ac247ec-560f-41ef-96cb-781243e8e1ba tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:40.045356 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1ac247ec-560f-41ef-96cb-781243e8e1ba tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:40.046116 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1ac247ec-560f-41ef-96cb-781243e8e1ba tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:40.046550 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1ac247ec-560f-41ef-96cb-781243e8e1ba tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:40.109012 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-2adf0c08-2c45-4d60-92a6-969dc22857ff tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:40.112495 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=100 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:40.116718 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2adf0c08-2c45-4d60-92a6-969dc22857ff tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1223 microversion: 2.1 time: 0.088034 Jun 22 08:59:40.117300 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 172/312] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:40 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:40.124557 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-1ac247ec-560f-41ef-96cb-781243e8e1ba tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:40.132596 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1ac247ec-560f-41ef-96cb-781243e8e1ba tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1266 microversion: 2.1 time: 0.097567 Jun 22 08:59:40.133263 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 141/313] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:40 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:40.470405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-5d9b6280-afab-4080-9ec2-7544d7241275 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:40.470405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-5d9b6280-afab-4080-9ec2-7544d7241275 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:40.472807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5d9b6280-afab-4080-9ec2-7544d7241275 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:40.473275 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5d9b6280-afab-4080-9ec2-7544d7241275 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:40.474047 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5d9b6280-afab-4080-9ec2-7544d7241275 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:40.474490 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5d9b6280-afab-4080-9ec2-7544d7241275 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:40.614745 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-5d9b6280-afab-4080-9ec2-7544d7241275 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:40.628400 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-5d9b6280-afab-4080-9ec2-7544d7241275 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.167241 Jun 22 08:59:40.628999 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 173/314] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:40 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:41.043577 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ede1f7c4-8c8f-48be-b736-d8759fcbefdf tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:41.044207 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ede1f7c4-8c8f-48be-b736-d8759fcbefdf tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:41.051507 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ede1f7c4-8c8f-48be-b736-d8759fcbefdf tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:41.051715 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-8286d8ff-c12e-439c-b26c-40a60b72d9e7 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:41.052119 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ede1f7c4-8c8f-48be-b736-d8759fcbefdf tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:41.052330 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-8286d8ff-c12e-439c-b26c-40a60b72d9e7 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:41.052699 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ede1f7c4-8c8f-48be-b736-d8759fcbefdf tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:41.053160 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ede1f7c4-8c8f-48be-b736-d8759fcbefdf tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:41.058342 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8286d8ff-c12e-439c-b26c-40a60b72d9e7 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:41.058796 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8286d8ff-c12e-439c-b26c-40a60b72d9e7 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:41.059829 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8286d8ff-c12e-439c-b26c-40a60b72d9e7 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:41.060274 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8286d8ff-c12e-439c-b26c-40a60b72d9e7 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:41.257504 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ede1f7c4-8c8f-48be-b736-d8759fcbefdf tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:41.261178 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-8286d8ff-c12e-439c-b26c-40a60b72d9e7 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:41.266017 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ede1f7c4-8c8f-48be-b736-d8759fcbefdf tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1522 microversion: 2.1 time: 0.226253 Jun 22 08:59:41.266589 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 142/315] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:41 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:41.269953 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-8286d8ff-c12e-439c-b26c-40a60b72d9e7 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:41.271048 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-2250eefe-6f90-4dad-9662-907e22e5241b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:41.271476 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-8286d8ff-c12e-439c-b26c-40a60b72d9e7 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:41.271652 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-2250eefe-6f90-4dad-9662-907e22e5241b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:41.272596 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-8286d8ff-c12e-439c-b26c-40a60b72d9e7 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.224797 Jun 22 08:59:41.281949 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 174/316] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:41 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 08:59:41.282143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2250eefe-6f90-4dad-9662-907e22e5241b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:41.282143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2250eefe-6f90-4dad-9662-907e22e5241b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:41.282302 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a4617420-b1c4-42b5-b1b2-87324b1c3b2f tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:41.282377 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2250eefe-6f90-4dad-9662-907e22e5241b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:41.282446 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-a4617420-b1c4-42b5-b1b2-87324b1c3b2f tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:41.282515 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2250eefe-6f90-4dad-9662-907e22e5241b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:41.285180 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a4617420-b1c4-42b5-b1b2-87324b1c3b2f tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:41.285639 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a4617420-b1c4-42b5-b1b2-87324b1c3b2f tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:41.286408 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a4617420-b1c4-42b5-b1b2-87324b1c3b2f tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:41.286895 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a4617420-b1c4-42b5-b1b2-87324b1c3b2f tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:41.351595 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-2250eefe-6f90-4dad-9662-907e22e5241b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:41.360673 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-2250eefe-6f90-4dad-9662-907e22e5241b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1223 microversion: 2.1 time: 0.093080 Jun 22 08:59:41.361494 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 143/317] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:41 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:41.368095 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-a4617420-b1c4-42b5-b1b2-87324b1c3b2f tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:41.376300 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a4617420-b1c4-42b5-b1b2-87324b1c3b2f tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1266 microversion: 2.1 time: 0.101772 Jun 22 08:59:41.376899 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 175/318] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:41 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1266 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:41.644459 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-adedf144-37a8-4a3f-a531-ca2ecfdf6ae9 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:41.645101 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-adedf144-37a8-4a3f-a531-ca2ecfdf6ae9 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:41.651346 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-adedf144-37a8-4a3f-a531-ca2ecfdf6ae9 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:41.651880 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-adedf144-37a8-4a3f-a531-ca2ecfdf6ae9 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:41.652677 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-adedf144-37a8-4a3f-a531-ca2ecfdf6ae9 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:41.659918 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-adedf144-37a8-4a3f-a531-ca2ecfdf6ae9 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:41.784155 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-adedf144-37a8-4a3f-a531-ca2ecfdf6ae9 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:41.791562 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-adedf144-37a8-4a3f-a531-ca2ecfdf6ae9 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.151225 Jun 22 08:59:41.792132 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 144/319] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:41 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:42.282873 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f8aec4e8-e6e6-46a2-a465-e2806c49e8dc tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:42.283413 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-f8aec4e8-e6e6-46a2-a465-e2806c49e8dc tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:42.289677 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f8aec4e8-e6e6-46a2-a465-e2806c49e8dc tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:42.290133 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f8aec4e8-e6e6-46a2-a465-e2806c49e8dc tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:42.290668 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ad2878bb-aa53-424c-9bb1-397e49381a49 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:42.291073 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f8aec4e8-e6e6-46a2-a465-e2806c49e8dc tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:42.291288 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ad2878bb-aa53-424c-9bb1-397e49381a49 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:42.291382 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f8aec4e8-e6e6-46a2-a465-e2806c49e8dc tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:42.298399 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ad2878bb-aa53-424c-9bb1-397e49381a49 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:42.298854 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ad2878bb-aa53-424c-9bb1-397e49381a49 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:42.299621 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ad2878bb-aa53-424c-9bb1-397e49381a49 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:42.300068 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ad2878bb-aa53-424c-9bb1-397e49381a49 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:42.519673 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-f8aec4e8-e6e6-46a2-a465-e2806c49e8dc tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:42.530502 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f8aec4e8-e6e6-46a2-a465-e2806c49e8dc tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1522 microversion: 2.1 time: 0.251582 Jun 22 08:59:42.531215 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ad2878bb-aa53-424c-9bb1-397e49381a49 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:42.534006 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 176/320] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:42 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:42.539685 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f464e0a3-5726-47df-b5ed-bb7c77b7b2bf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:42.540287 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-f464e0a3-5726-47df-b5ed-bb7c77b7b2bf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:42.541626 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ad2878bb-aa53-424c-9bb1-397e49381a49 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:42.544344 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ad2878bb-aa53-424c-9bb1-397e49381a49 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:42.546493 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f464e0a3-5726-47df-b5ed-bb7c77b7b2bf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:42.546947 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f464e0a3-5726-47df-b5ed-bb7c77b7b2bf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:42.547711 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f464e0a3-5726-47df-b5ed-bb7c77b7b2bf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:42.548144 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f464e0a3-5726-47df-b5ed-bb7c77b7b2bf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:42.549703 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ad2878bb-aa53-424c-9bb1-397e49381a49 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1407 microversion: 2.20 time: 0.258732 Jun 22 08:59:42.550298 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 145/321] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:42 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 08:59:42.554773 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-0aac24a7-b773-4b5e-9eb0-8372a4b96a1c tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:42.555392 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-0aac24a7-b773-4b5e-9eb0-8372a4b96a1c tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:42.562027 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0aac24a7-b773-4b5e-9eb0-8372a4b96a1c tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:42.562529 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0aac24a7-b773-4b5e-9eb0-8372a4b96a1c tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:42.563264 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0aac24a7-b773-4b5e-9eb0-8372a4b96a1c tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:42.563930 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0aac24a7-b773-4b5e-9eb0-8372a4b96a1c tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:42.622618 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-f464e0a3-5726-47df-b5ed-bb7c77b7b2bf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:42.631214 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f464e0a3-5726-47df-b5ed-bb7c77b7b2bf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1215 microversion: 2.1 time: 0.096209 Jun 22 08:59:42.631869 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 177/322] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:42 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1215 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:42.638680 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-0aac24a7-b773-4b5e-9eb0-8372a4b96a1c tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:42.646330 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-0aac24a7-b773-4b5e-9eb0-8372a4b96a1c tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1266 microversion: 2.1 time: 0.095064 Jun 22 08:59:42.646928 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 146/323] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:42 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:42.808881 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-bf8a406f-226a-4207-89b8-15a27d40ebd2 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:42.809696 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-bf8a406f-226a-4207-89b8-15a27d40ebd2 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:42.816524 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bf8a406f-226a-4207-89b8-15a27d40ebd2 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:42.817013 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bf8a406f-226a-4207-89b8-15a27d40ebd2 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:42.817791 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bf8a406f-226a-4207-89b8-15a27d40ebd2 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:42.818232 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bf8a406f-226a-4207-89b8-15a27d40ebd2 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:42.947977 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-bf8a406f-226a-4207-89b8-15a27d40ebd2 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:42.955525 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-bf8a406f-226a-4207-89b8-15a27d40ebd2 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.150704 Jun 22 08:59:42.956094 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 178/324] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:42 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:43.550562 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ef0d891d-7600-4bd7-b07f-95564a08ae10 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:43.551161 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ef0d891d-7600-4bd7-b07f-95564a08ae10 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:43.553040 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell0:SELECT=2 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:43.553681 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell0:SELECT=6 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:43.558888 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ef0d891d-7600-4bd7-b07f-95564a08ae10 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:43.559592 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ef0d891d-7600-4bd7-b07f-95564a08ae10 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:43.560989 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ef0d891d-7600-4bd7-b07f-95564a08ae10 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:43.560989 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ef0d891d-7600-4bd7-b07f-95564a08ae10 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:43.567742 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7692da2c-eab7-4de8-9b62-012cfd205515 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:43.568283 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7692da2c-eab7-4de8-9b62-012cfd205515 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:43.574415 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7692da2c-eab7-4de8-9b62-012cfd205515 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:43.574864 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7692da2c-eab7-4de8-9b62-012cfd205515 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:43.575629 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7692da2c-eab7-4de8-9b62-012cfd205515 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:43.576237 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7692da2c-eab7-4de8-9b62-012cfd205515 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:43.823755 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ef0d891d-7600-4bd7-b07f-95564a08ae10 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:43.832336 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ef0d891d-7600-4bd7-b07f-95564a08ae10 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1522 microversion: 2.1 time: 0.285755 Jun 22 08:59:43.842073 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 147/325] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:43 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:43.842073 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-bab3af08-80dc-4d51-a322-7db9266e4442 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:43.842073 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-bab3af08-80dc-4d51-a322-7db9266e4442 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:43.844757 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bab3af08-80dc-4d51-a322-7db9266e4442 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:43.845243 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bab3af08-80dc-4d51-a322-7db9266e4442 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:43.845994 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bab3af08-80dc-4d51-a322-7db9266e4442 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:43.846424 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bab3af08-80dc-4d51-a322-7db9266e4442 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:43.854714 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7692da2c-eab7-4de8-9b62-012cfd205515 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:43.863896 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7692da2c-eab7-4de8-9b62-012cfd205515 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:43.865432 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7692da2c-eab7-4de8-9b62-012cfd205515 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:43.877637 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7692da2c-eab7-4de8-9b62-012cfd205515 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1597 microversion: 2.20 time: 0.302877 Jun 22 08:59:43.877637 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 179/326] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 08:59:43 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1597 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 08:59:43.877637 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2337653c-f1c1-4d68-a0a2-a5acc07ef76e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:43.877637 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2337653c-f1c1-4d68-a0a2-a5acc07ef76e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:43.879629 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2337653c-f1c1-4d68-a0a2-a5acc07ef76e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:43.880278 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2337653c-f1c1-4d68-a0a2-a5acc07ef76e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:43.881072 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2337653c-f1c1-4d68-a0a2-a5acc07ef76e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:43.881736 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2337653c-f1c1-4d68-a0a2-a5acc07ef76e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:43.914664 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-bab3af08-80dc-4d51-a322-7db9266e4442 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:43.923301 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-bab3af08-80dc-4d51-a322-7db9266e4442 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1215 microversion: 2.1 time: 0.089350 Jun 22 08:59:43.926280 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 148/327] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:43 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:43.928657 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-9f9d0d64-32d6-4b9a-a6e0-e7f8fab962ca tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:43.929210 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-9f9d0d64-32d6-4b9a-a6e0-e7f8fab962ca tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:43.935970 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9f9d0d64-32d6-4b9a-a6e0-e7f8fab962ca tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:43.936466 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9f9d0d64-32d6-4b9a-a6e0-e7f8fab962ca tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:43.937507 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9f9d0d64-32d6-4b9a-a6e0-e7f8fab962ca tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:43.937946 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9f9d0d64-32d6-4b9a-a6e0-e7f8fab962ca tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:43.946596 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell0:SELECT=2 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:43.956705 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-2337653c-f1c1-4d68-a0a2-a5acc07ef76e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:43.964091 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2337653c-f1c1-4d68-a0a2-a5acc07ef76e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1274 microversion: 2.1 time: 0.095933 Jun 22 08:59:43.964659 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 180/328] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:43 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1274 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:43.972474 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c3b632f2-e587-4570-a50d-c12e178a74e9 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:43.973251 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c3b632f2-e587-4570-a50d-c12e178a74e9 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:43.979285 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c3b632f2-e587-4570-a50d-c12e178a74e9 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:43.979945 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c3b632f2-e587-4570-a50d-c12e178a74e9 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:43.980568 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c3b632f2-e587-4570-a50d-c12e178a74e9 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:43.981036 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c3b632f2-e587-4570-a50d-c12e178a74e9 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:44.035906 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-9f9d0d64-32d6-4b9a-a6e0-e7f8fab962ca tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.110943 Jun 22 08:59:44.039452 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 149/329] 10.222.0.16 () {60 vars in 1315 bytes} [Wed Jun 22 08:59:43 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 08:59:44.131171 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c3b632f2-e587-4570-a50d-c12e178a74e9 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:44.138987 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c3b632f2-e587-4570-a50d-c12e178a74e9 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1366 microversion: 2.1 time: 0.171353 Jun 22 08:59:44.140070 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 181/330] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:43 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:44.849990 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-33495ee3-06e4-4850-999d-d1189e0db341 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:44.851280 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-33495ee3-06e4-4850-999d-d1189e0db341 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:44.857641 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-33495ee3-06e4-4850-999d-d1189e0db341 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:44.859511 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-33495ee3-06e4-4850-999d-d1189e0db341 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:44.860503 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-33495ee3-06e4-4850-999d-d1189e0db341 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:44.861145 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-33495ee3-06e4-4850-999d-d1189e0db341 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:44.941962 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-59f4b7b0-eee3-495e-af4a-95f1deb1fc74 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:44.942544 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-59f4b7b0-eee3-495e-af4a-95f1deb1fc74 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:44.948751 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-59f4b7b0-eee3-495e-af4a-95f1deb1fc74 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:44.949432 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-59f4b7b0-eee3-495e-af4a-95f1deb1fc74 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:44.950372 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-59f4b7b0-eee3-495e-af4a-95f1deb1fc74 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:44.950963 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-59f4b7b0-eee3-495e-af4a-95f1deb1fc74 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:45.015966 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-33495ee3-06e4-4850-999d-d1189e0db341 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:45.028398 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-33495ee3-06e4-4850-999d-d1189e0db341 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1522 microversion: 2.1 time: 0.182549 Jun 22 08:59:45.029651 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 150/331] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:44 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:45.037777 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c354a9e2-0e92-4042-94e6-fbc6cc13c1a1 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:45.041942 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c354a9e2-0e92-4042-94e6-fbc6cc13c1a1 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:45.046793 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c354a9e2-0e92-4042-94e6-fbc6cc13c1a1 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:45.047713 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c354a9e2-0e92-4042-94e6-fbc6cc13c1a1 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:45.048711 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c354a9e2-0e92-4042-94e6-fbc6cc13c1a1 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:45.049320 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c354a9e2-0e92-4042-94e6-fbc6cc13c1a1 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:45.108985 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-59f4b7b0-eee3-495e-af4a-95f1deb1fc74 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:45.117228 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-59f4b7b0-eee3-495e-af4a-95f1deb1fc74 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1271 microversion: 2.1 time: 0.180554 Jun 22 08:59:45.127810 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 182/332] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:44 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1271 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:45.151761 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-c354a9e2-0e92-4042-94e6-fbc6cc13c1a1 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:45.158696 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-78c48cb5-a7ca-4ff2-97bf-390403b1b881 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:45.160195 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-78c48cb5-a7ca-4ff2-97bf-390403b1b881 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:45.164107 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c354a9e2-0e92-4042-94e6-fbc6cc13c1a1 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1274 microversion: 2.1 time: 0.132855 Jun 22 08:59:45.164928 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 151/333] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:45 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1274 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:45.168333 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-78c48cb5-a7ca-4ff2-97bf-390403b1b881 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:45.169059 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-78c48cb5-a7ca-4ff2-97bf-390403b1b881 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:45.169989 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-78c48cb5-a7ca-4ff2-97bf-390403b1b881 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:45.170747 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-78c48cb5-a7ca-4ff2-97bf-390403b1b881 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:45.264063 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [req-4de4f479-4116-440d-9459-82113ec4eb2e req-5bf601ed-6b7f-4ecd-b2bd-00b89c1c6d97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dce83571-cd21-48a3-b54d-b6218f563363", "tag": "9ecba298-5328-4f62-bebc-dac62013eb8f"}]} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:59:45.276585 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-4de4f479-4116-440d-9459-82113ec4eb2e req-5bf601ed-6b7f-4ecd-b2bd-00b89c1c6d97 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:45.277157 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-4de4f479-4116-440d-9459-82113ec4eb2e req-5bf601ed-6b7f-4ecd-b2bd-00b89c1c6d97 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:45.294421 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.compute.server_external_events [req-4de4f479-4116-440d-9459-82113ec4eb2e req-5bf601ed-6b7f-4ecd-b2bd-00b89c1c6d97 service nova] Creating event network-changed:9ecba298-5328-4f62-bebc-dac62013eb8f for instance dce83571-cd21-48a3-b54d-b6218f563363 on hv-cinder-84599 Jun 22 08:59:45.301051 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [req-4de4f479-4116-440d-9459-82113ec4eb2e req-5bf601ed-6b7f-4ecd-b2bd-00b89c1c6d97 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043884 Jun 22 08:59:45.302172 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 152/334] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 08:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:59:45.333339 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-78c48cb5-a7ca-4ff2-97bf-390403b1b881 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:45.341087 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-78c48cb5-a7ca-4ff2-97bf-390403b1b881 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1556 microversion: 2.1 time: 0.188426 Jun 22 08:59:45.341651 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 183/335] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:45 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1556 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:45.359583 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-10e966fa-6a53-4821-b0cd-8ab015c8793e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:45.360162 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-10e966fa-6a53-4821-b0cd-8ab015c8793e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:45.366751 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-10e966fa-6a53-4821-b0cd-8ab015c8793e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:45.370997 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-10e966fa-6a53-4821-b0cd-8ab015c8793e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:45.370997 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-10e966fa-6a53-4821-b0cd-8ab015c8793e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:45.370997 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-10e966fa-6a53-4821-b0cd-8ab015c8793e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:45.446324 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-10e966fa-6a53-4821-b0cd-8ab015c8793e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091054 Jun 22 08:59:45.446912 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 153/336] 10.222.0.16 () {58 vars in 1274 bytes} [Wed Jun 22 08:59:45 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:59:46.046536 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-74978f59-9e7c-4b66-b007-56d00dc17dab tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:46.057519 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-74978f59-9e7c-4b66-b007-56d00dc17dab tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:46.072533 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-74978f59-9e7c-4b66-b007-56d00dc17dab tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:46.073275 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-74978f59-9e7c-4b66-b007-56d00dc17dab tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:46.074057 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-74978f59-9e7c-4b66-b007-56d00dc17dab tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:46.074495 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-74978f59-9e7c-4b66-b007-56d00dc17dab tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:46.134373 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-d04c11bc-4793-4f20-9ffc-b2dcfe0c4ef6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:46.138029 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-d04c11bc-4793-4f20-9ffc-b2dcfe0c4ef6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:46.146489 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d04c11bc-4793-4f20-9ffc-b2dcfe0c4ef6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:46.147227 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d04c11bc-4793-4f20-9ffc-b2dcfe0c4ef6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:46.148218 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d04c11bc-4793-4f20-9ffc-b2dcfe0c4ef6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:46.148860 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d04c11bc-4793-4f20-9ffc-b2dcfe0c4ef6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:46.321779 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-d04c11bc-4793-4f20-9ffc-b2dcfe0c4ef6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:46.335227 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-d04c11bc-4793-4f20-9ffc-b2dcfe0c4ef6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1271 microversion: 2.1 time: 0.204683 Jun 22 08:59:46.336746 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 154/337] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:46 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1271 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:46.343713 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-27e66917-9f8b-409e-aba0-915e9b787200 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:46.345084 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-27e66917-9f8b-409e-aba0-915e9b787200 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:46.353784 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-27e66917-9f8b-409e-aba0-915e9b787200 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:46.355229 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-27e66917-9f8b-409e-aba0-915e9b787200 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:46.356959 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-27e66917-9f8b-409e-aba0-915e9b787200 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:46.357550 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-27e66917-9f8b-409e-aba0-915e9b787200 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:46.495486 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-27e66917-9f8b-409e-aba0-915e9b787200 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:46.511153 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-27e66917-9f8b-409e-aba0-915e9b787200 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1272 microversion: 2.1 time: 0.172979 Jun 22 08:59:46.512066 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 155/338] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:46 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1272 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:46.552680 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-74978f59-9e7c-4b66-b007-56d00dc17dab tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:46.564919 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-74978f59-9e7c-4b66-b007-56d00dc17dab tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1522 microversion: 2.1 time: 0.522900 Jun 22 08:59:46.565587 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 184/339] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:46 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1522 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:47.158792 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [req-d38109d4-0173-4dce-b128-5dd02644c576 req-ed41f0b0-a0af-433d-a22f-c33e97069a92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10", "tag": "9678ec97-a7d2-4f9c-aa09-000750551309"}]} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:59:47.168475 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-d38109d4-0173-4dce-b128-5dd02644c576 req-ed41f0b0-a0af-433d-a22f-c33e97069a92 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:47.169205 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-d38109d4-0173-4dce-b128-5dd02644c576 req-ed41f0b0-a0af-433d-a22f-c33e97069a92 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:47.198142 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.compute.server_external_events [req-d38109d4-0173-4dce-b128-5dd02644c576 req-ed41f0b0-a0af-433d-a22f-c33e97069a92 service nova] Creating event network-changed:9678ec97-a7d2-4f9c-aa09-000750551309 for instance cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 on hv-cinder-84599 Jun 22 08:59:47.207842 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [req-d38109d4-0173-4dce-b128-5dd02644c576 req-ed41f0b0-a0af-433d-a22f-c33e97069a92 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053695 Jun 22 08:59:47.208463 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 156/340] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 08:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:59:47.353781 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d43d264b-45c7-480a-b70d-6da2c5d642e5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:47.354476 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-d43d264b-45c7-480a-b70d-6da2c5d642e5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:47.366930 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d43d264b-45c7-480a-b70d-6da2c5d642e5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:47.367390 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d43d264b-45c7-480a-b70d-6da2c5d642e5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:47.368182 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d43d264b-45c7-480a-b70d-6da2c5d642e5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:47.368632 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d43d264b-45c7-480a-b70d-6da2c5d642e5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:47.470184 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-d43d264b-45c7-480a-b70d-6da2c5d642e5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:47.478363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d43d264b-45c7-480a-b70d-6da2c5d642e5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1279 microversion: 2.1 time: 0.129223 Jun 22 08:59:47.499711 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 185/341] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:47 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1279 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:47.535799 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-537d2698-682c-413f-be4d-45660429321c tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:47.537287 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-537d2698-682c-413f-be4d-45660429321c tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:47.542313 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:47.549434 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-537d2698-682c-413f-be4d-45660429321c tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:47.550492 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-537d2698-682c-413f-be4d-45660429321c tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:47.551784 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-537d2698-682c-413f-be4d-45660429321c tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:47.552531 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-537d2698-682c-413f-be4d-45660429321c tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:47.583437 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-49aee654-4aaa-4b1e-80b4-9c0d93944b48 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:47.584608 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-49aee654-4aaa-4b1e-80b4-9c0d93944b48 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:47.591264 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-49aee654-4aaa-4b1e-80b4-9c0d93944b48 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:47.591922 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-49aee654-4aaa-4b1e-80b4-9c0d93944b48 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:47.593259 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-49aee654-4aaa-4b1e-80b4-9c0d93944b48 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:47.593726 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-49aee654-4aaa-4b1e-80b4-9c0d93944b48 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:47.754616 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-537d2698-682c-413f-be4d-45660429321c tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:47.761442 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=100 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:47.770306 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-537d2698-682c-413f-be4d-45660429321c tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1314 microversion: 2.1 time: 0.243665 Jun 22 08:59:47.770951 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 157/342] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:47 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:47.783684 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-49aee654-4aaa-4b1e-80b4-9c0d93944b48 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:47.791122 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-49aee654-4aaa-4b1e-80b4-9c0d93944b48 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1522 microversion: 2.1 time: 0.211703 Jun 22 08:59:47.791683 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 186/343] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:47 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:48.496158 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1c48bd0c-a3e0-4392-b56e-cfb629e96188 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:48.497367 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1c48bd0c-a3e0-4392-b56e-cfb629e96188 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:48.505726 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1c48bd0c-a3e0-4392-b56e-cfb629e96188 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:48.506168 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1c48bd0c-a3e0-4392-b56e-cfb629e96188 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:48.507108 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1c48bd0c-a3e0-4392-b56e-cfb629e96188 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:48.507540 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1c48bd0c-a3e0-4392-b56e-cfb629e96188 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:48.573386 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-1c48bd0c-a3e0-4392-b56e-cfb629e96188 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:48.581884 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1c48bd0c-a3e0-4392-b56e-cfb629e96188 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1279 microversion: 2.1 time: 0.089788 Jun 22 08:59:48.582453 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 158/344] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:48 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1279 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:48.787662 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f8a3e2a4-10e9-4a9a-8187-0139396a2759 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:48.788332 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-f8a3e2a4-10e9-4a9a-8187-0139396a2759 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:48.794702 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f8a3e2a4-10e9-4a9a-8187-0139396a2759 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:48.795162 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f8a3e2a4-10e9-4a9a-8187-0139396a2759 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:48.796428 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f8a3e2a4-10e9-4a9a-8187-0139396a2759 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:48.796896 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f8a3e2a4-10e9-4a9a-8187-0139396a2759 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:48.809122 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f699972e-35da-41bd-8beb-77da898cd14e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:48.809839 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f699972e-35da-41bd-8beb-77da898cd14e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:48.816661 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f699972e-35da-41bd-8beb-77da898cd14e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:48.817213 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f699972e-35da-41bd-8beb-77da898cd14e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:48.818238 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f699972e-35da-41bd-8beb-77da898cd14e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:48.818759 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f699972e-35da-41bd-8beb-77da898cd14e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:49.012441 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-f8a3e2a4-10e9-4a9a-8187-0139396a2759 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:49.017980 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-f699972e-35da-41bd-8beb-77da898cd14e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:49.024004 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f699972e-35da-41bd-8beb-77da898cd14e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1522 microversion: 2.1 time: 0.219272 Jun 22 08:59:49.024649 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 159/345] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:48 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:49.025685 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f8a3e2a4-10e9-4a9a-8187-0139396a2759 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1314 microversion: 2.1 time: 0.242025 Jun 22 08:59:49.035571 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 187/346] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:48 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:49.600055 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-d124001a-9128-4c8a-a449-39468e1d2189 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:49.600671 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-d124001a-9128-4c8a-a449-39468e1d2189 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:49.607639 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d124001a-9128-4c8a-a449-39468e1d2189 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:49.608631 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d124001a-9128-4c8a-a449-39468e1d2189 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:49.609539 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d124001a-9128-4c8a-a449-39468e1d2189 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:49.609980 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d124001a-9128-4c8a-a449-39468e1d2189 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:49.675142 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-d124001a-9128-4c8a-a449-39468e1d2189 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:49.684140 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-d124001a-9128-4c8a-a449-39468e1d2189 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1279 microversion: 2.1 time: 0.088647 Jun 22 08:59:49.694074 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 160/347] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:49 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1279 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:50.044411 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-71514a08-8af4-4e7e-a2ea-367c377ac9d0 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:50.047721 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-71514a08-8af4-4e7e-a2ea-367c377ac9d0 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:50.048185 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-05f47c8e-c46b-4799-b10d-9a4560edb847 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:50.049143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-05f47c8e-c46b-4799-b10d-9a4560edb847 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:50.056121 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-05f47c8e-c46b-4799-b10d-9a4560edb847 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:50.056921 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-05f47c8e-c46b-4799-b10d-9a4560edb847 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:50.057300 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-71514a08-8af4-4e7e-a2ea-367c377ac9d0 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:50.057770 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-71514a08-8af4-4e7e-a2ea-367c377ac9d0 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:50.059002 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-71514a08-8af4-4e7e-a2ea-367c377ac9d0 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:50.059257 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-05f47c8e-c46b-4799-b10d-9a4560edb847 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:50.059802 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-71514a08-8af4-4e7e-a2ea-367c377ac9d0 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:50.060162 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-05f47c8e-c46b-4799-b10d-9a4560edb847 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:50.298992 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-05f47c8e-c46b-4799-b10d-9a4560edb847 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:50.304006 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-71514a08-8af4-4e7e-a2ea-367c377ac9d0 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:50.310689 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-05f47c8e-c46b-4799-b10d-9a4560edb847 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1314 microversion: 2.1 time: 0.271620 Jun 22 08:59:50.312106 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 161/348] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:50 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:50.314001 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-71514a08-8af4-4e7e-a2ea-367c377ac9d0 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1522 microversion: 2.1 time: 0.275224 Jun 22 08:59:50.316731 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 188/349] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:50 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:50.435438 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [req-221ec533-2d70-4279-b025-d9c322fce98d req-f57cdb68-ad12-4f2e-839c-5fdb2f7e9bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcee9695-f963-4f49-a7c9-5ec8625273cf", "tag": "7ba885ec-f8db-4e7a-8345-1e4ec200323b"}]} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:59:50.445191 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-221ec533-2d70-4279-b025-d9c322fce98d req-f57cdb68-ad12-4f2e-839c-5fdb2f7e9bc1 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:50.445635 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-221ec533-2d70-4279-b025-d9c322fce98d req-f57cdb68-ad12-4f2e-839c-5fdb2f7e9bc1 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:50.469848 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.compute.server_external_events [req-221ec533-2d70-4279-b025-d9c322fce98d req-f57cdb68-ad12-4f2e-839c-5fdb2f7e9bc1 service nova] Creating event network-changed:7ba885ec-f8db-4e7a-8345-1e4ec200323b for instance fcee9695-f963-4f49-a7c9-5ec8625273cf on hv-cinder-84599 Jun 22 08:59:50.474869 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [req-221ec533-2d70-4279-b025-d9c322fce98d req-f57cdb68-ad12-4f2e-839c-5fdb2f7e9bc1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052346 Jun 22 08:59:50.475457 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 162/350] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 08:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:59:50.702990 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-ac781e95-c13a-409c-b0bb-1942606102f8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:50.704265 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-ac781e95-c13a-409c-b0bb-1942606102f8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:50.710913 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ac781e95-c13a-409c-b0bb-1942606102f8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:50.710913 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ac781e95-c13a-409c-b0bb-1942606102f8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:50.727212 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ac781e95-c13a-409c-b0bb-1942606102f8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:50.727212 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ac781e95-c13a-409c-b0bb-1942606102f8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:50.752057 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=100 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:50.801075 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-ac781e95-c13a-409c-b0bb-1942606102f8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:50.812737 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-ac781e95-c13a-409c-b0bb-1942606102f8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1277 microversion: 2.1 time: 0.113886 Jun 22 08:59:50.813331 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 189/351] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:50 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1277 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:51.329689 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-38995527-02c7-44f2-856a-68af146ecac4 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:51.330389 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-38995527-02c7-44f2-856a-68af146ecac4 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:51.337961 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-38995527-02c7-44f2-856a-68af146ecac4 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:51.338225 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ead09b92-31f1-4d2c-9fb6-75306c4c5fc5 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:51.338655 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-38995527-02c7-44f2-856a-68af146ecac4 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:51.338746 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ead09b92-31f1-4d2c-9fb6-75306c4c5fc5 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:51.339321 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-38995527-02c7-44f2-856a-68af146ecac4 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:51.339903 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-38995527-02c7-44f2-856a-68af146ecac4 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:51.346410 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ead09b92-31f1-4d2c-9fb6-75306c4c5fc5 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:51.346780 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ead09b92-31f1-4d2c-9fb6-75306c4c5fc5 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:51.347568 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ead09b92-31f1-4d2c-9fb6-75306c4c5fc5 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:51.348189 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ead09b92-31f1-4d2c-9fb6-75306c4c5fc5 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:51.379742 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ead09b92-31f1-4d2c-9fb6-75306c4c5fc5 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Going to try to terminate instance {{(pid=118024) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 08:59:51.509011 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-38995527-02c7-44f2-856a-68af146ecac4 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:51.517503 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-38995527-02c7-44f2-856a-68af146ecac4 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1314 microversion: 2.1 time: 0.192578 Jun 22 08:59:51.518080 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 190/352] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:51 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:51.533581 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a6965d2e-53d1-457a-9ba2-5963108d2d6e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:51.534412 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-a6965d2e-53d1-457a-9ba2-5963108d2d6e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:51.540645 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a6965d2e-53d1-457a-9ba2-5963108d2d6e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:51.541314 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a6965d2e-53d1-457a-9ba2-5963108d2d6e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:51.542247 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a6965d2e-53d1-457a-9ba2-5963108d2d6e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:51.542872 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a6965d2e-53d1-457a-9ba2-5963108d2d6e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:51.695288 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-a6965d2e-53d1-457a-9ba2-5963108d2d6e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:51.704101 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a6965d2e-53d1-457a-9ba2-5963108d2d6e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1522 microversion: 2.1 time: 0.174691 Jun 22 08:59:51.704896 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 191/353] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:51 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:51.730593 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ead09b92-31f1-4d2c-9fb6-75306c4c5fc5 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 204 len: 0 microversion: 2.1 time: 0.402374 Jun 22 08:59:51.730593 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 163/354] 10.222.0.16 () {58 vars in 1238 bytes} [Wed Jun 22 08:59:51 2022] DELETE /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 08:59:51.736973 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-6841f994-59a9-49f5-a2ff-d874f5b2ac36 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:51.737776 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-6841f994-59a9-49f5-a2ff-d874f5b2ac36 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:51.743936 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6841f994-59a9-49f5-a2ff-d874f5b2ac36 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:51.744451 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6841f994-59a9-49f5-a2ff-d874f5b2ac36 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:51.745314 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6841f994-59a9-49f5-a2ff-d874f5b2ac36 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:51.746214 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6841f994-59a9-49f5-a2ff-d874f5b2ac36 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:51.830455 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-85a06513-a958-4edd-8ef5-edd164853b07 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:51.831243 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-85a06513-a958-4edd-8ef5-edd164853b07 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:51.839010 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-85a06513-a958-4edd-8ef5-edd164853b07 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:51.841186 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-85a06513-a958-4edd-8ef5-edd164853b07 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:51.841970 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-85a06513-a958-4edd-8ef5-edd164853b07 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:51.843050 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-85a06513-a958-4edd-8ef5-edd164853b07 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:51.895833 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-6841f994-59a9-49f5-a2ff-d874f5b2ac36 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:51.904079 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-6841f994-59a9-49f5-a2ff-d874f5b2ac36 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1553 microversion: 2.1 time: 0.171153 Jun 22 08:59:51.904667 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 192/355] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:51 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:51.989258 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-85a06513-a958-4edd-8ef5-edd164853b07 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:51.996808 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-85a06513-a958-4edd-8ef5-edd164853b07 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1319 microversion: 2.1 time: 0.171339 Jun 22 08:59:51.997491 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 164/356] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:51 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:52.489617 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-3f8de398-d8da-4e71-94cf-615c022804f0 req-a266b9ed-5b30-41c4-84fc-df5ceeaca3ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0c80904-64ab-4f87-98d3-89784b0b0f96", "tag": "a3085c34-2f17-4743-8ee5-dda470978f80"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:59:52.497911 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-3f8de398-d8da-4e71-94cf-615c022804f0 req-a266b9ed-5b30-41c4-84fc-df5ceeaca3ce service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:52.498412 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-3f8de398-d8da-4e71-94cf-615c022804f0 req-a266b9ed-5b30-41c4-84fc-df5ceeaca3ce service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:52.509890 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-3f8de398-d8da-4e71-94cf-615c022804f0 req-a266b9ed-5b30-41c4-84fc-df5ceeaca3ce service nova] Creating event network-changed:a3085c34-2f17-4743-8ee5-dda470978f80 for instance f0c80904-64ab-4f87-98d3-89784b0b0f96 on hv-cinder-84599 Jun 22 08:59:52.515081 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-3f8de398-d8da-4e71-94cf-615c022804f0 req-a266b9ed-5b30-41c4-84fc-df5ceeaca3ce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029251 Jun 22 08:59:52.515667 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 193/357] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 08:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:59:52.534695 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b916c8ba-0f06-4331-a74e-80ad48e6ca1a tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:52.535307 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-b916c8ba-0f06-4331-a74e-80ad48e6ca1a tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:52.541713 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b916c8ba-0f06-4331-a74e-80ad48e6ca1a tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:52.542162 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b916c8ba-0f06-4331-a74e-80ad48e6ca1a tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:52.542916 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b916c8ba-0f06-4331-a74e-80ad48e6ca1a tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:52.543348 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b916c8ba-0f06-4331-a74e-80ad48e6ca1a tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:52.671863 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-b916c8ba-0f06-4331-a74e-80ad48e6ca1a tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:52.679459 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-b916c8ba-0f06-4331-a74e-80ad48e6ca1a tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1314 microversion: 2.1 time: 0.148584 Jun 22 08:59:52.681075 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 165/358] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:52 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:52.722044 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-32068c16-225a-40de-a0af-c081287cd4c5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:52.722757 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-32068c16-225a-40de-a0af-c081287cd4c5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:52.728944 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-32068c16-225a-40de-a0af-c081287cd4c5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:52.729402 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-32068c16-225a-40de-a0af-c081287cd4c5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:52.730174 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-32068c16-225a-40de-a0af-c081287cd4c5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:52.730621 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-32068c16-225a-40de-a0af-c081287cd4c5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:52.862446 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-32068c16-225a-40de-a0af-c081287cd4c5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:52.870095 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-32068c16-225a-40de-a0af-c081287cd4c5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1522 microversion: 2.1 time: 0.152902 Jun 22 08:59:52.870664 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 194/359] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:52 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:52.921216 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c75fe8e8-a1e4-4579-bc40-ffe26485a9c8 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:52.921756 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c75fe8e8-a1e4-4579-bc40-ffe26485a9c8 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:52.927776 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c75fe8e8-a1e4-4579-bc40-ffe26485a9c8 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:52.928222 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c75fe8e8-a1e4-4579-bc40-ffe26485a9c8 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:52.929028 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c75fe8e8-a1e4-4579-bc40-ffe26485a9c8 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:52.929464 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c75fe8e8-a1e4-4579-bc40-ffe26485a9c8 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:53.013516 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9a942f0c-efe9-4931-af64-81de7882fd71 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:53.014361 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9a942f0c-efe9-4931-af64-81de7882fd71 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:53.022449 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9a942f0c-efe9-4931-af64-81de7882fd71 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:53.023873 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9a942f0c-efe9-4931-af64-81de7882fd71 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:53.024817 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9a942f0c-efe9-4931-af64-81de7882fd71 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:53.025528 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9a942f0c-efe9-4931-af64-81de7882fd71 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:53.064141 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-c75fe8e8-a1e4-4579-bc40-ffe26485a9c8 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:53.072427 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c75fe8e8-a1e4-4579-bc40-ffe26485a9c8 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1553 microversion: 2.1 time: 0.155054 Jun 22 08:59:53.073047 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 166/360] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:52 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:53.160132 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9a942f0c-efe9-4931-af64-81de7882fd71 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:53.167673 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9a942f0c-efe9-4931-af64-81de7882fd71 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1319 microversion: 2.1 time: 0.158053 Jun 22 08:59:53.168351 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 195/361] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:53 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:53.697604 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-cba1de92-3748-40ff-b1cb-3fb37e04956e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:53.698343 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-cba1de92-3748-40ff-b1cb-3fb37e04956e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:53.705436 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cba1de92-3748-40ff-b1cb-3fb37e04956e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:53.705891 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cba1de92-3748-40ff-b1cb-3fb37e04956e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:53.706656 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cba1de92-3748-40ff-b1cb-3fb37e04956e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:53.707125 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cba1de92-3748-40ff-b1cb-3fb37e04956e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:53.887596 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-1bcff620-654a-4ee1-a307-8d444a7a6d83 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:53.891457 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-1bcff620-654a-4ee1-a307-8d444a7a6d83 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:53.897691 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1bcff620-654a-4ee1-a307-8d444a7a6d83 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:53.898442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1bcff620-654a-4ee1-a307-8d444a7a6d83 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:53.899592 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1bcff620-654a-4ee1-a307-8d444a7a6d83 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:53.900354 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1bcff620-654a-4ee1-a307-8d444a7a6d83 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:54.049138 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-cba1de92-3748-40ff-b1cb-3fb37e04956e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:54.057500 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-cba1de92-3748-40ff-b1cb-3fb37e04956e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1314 microversion: 2.1 time: 0.363963 Jun 22 08:59:54.058386 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 167/362] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:53 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:54.089159 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-1bcff620-654a-4ee1-a307-8d444a7a6d83 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:54.091673 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-15cf25fd-8a0a-42cf-bf1d-5dc08dd8b8d5 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:54.092628 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-15cf25fd-8a0a-42cf-bf1d-5dc08dd8b8d5 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:54.097547 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-1bcff620-654a-4ee1-a307-8d444a7a6d83 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1522 microversion: 2.1 time: 0.213964 Jun 22 08:59:54.098119 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 196/363] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:53 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:54.100991 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-15cf25fd-8a0a-42cf-bf1d-5dc08dd8b8d5 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:54.101442 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-15cf25fd-8a0a-42cf-bf1d-5dc08dd8b8d5 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:54.102214 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-15cf25fd-8a0a-42cf-bf1d-5dc08dd8b8d5 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:54.102649 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-15cf25fd-8a0a-42cf-bf1d-5dc08dd8b8d5 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:54.185418 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-39db012c-cf82-4eed-803a-353d6a0c849c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:54.186069 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-39db012c-cf82-4eed-803a-353d6a0c849c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:54.193133 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-39db012c-cf82-4eed-803a-353d6a0c849c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:54.193907 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-39db012c-cf82-4eed-803a-353d6a0c849c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:54.194887 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-39db012c-cf82-4eed-803a-353d6a0c849c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:54.195483 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-39db012c-cf82-4eed-803a-353d6a0c849c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:54.257423 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-15cf25fd-8a0a-42cf-bf1d-5dc08dd8b8d5 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:54.266946 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-15cf25fd-8a0a-42cf-bf1d-5dc08dd8b8d5 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1553 microversion: 2.1 time: 0.181004 Jun 22 08:59:54.276646 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 168/364] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:54 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1553 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:54.352233 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-39db012c-cf82-4eed-803a-353d6a0c849c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:54.360433 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-39db012c-cf82-4eed-803a-353d6a0c849c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1319 microversion: 2.1 time: 0.179060 Jun 22 08:59:54.361174 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 197/365] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:54 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:55.075798 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-94bb9c21-ee29-44ff-9179-7223e02ceac7 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:55.076686 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-94bb9c21-ee29-44ff-9179-7223e02ceac7 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:55.083937 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-94bb9c21-ee29-44ff-9179-7223e02ceac7 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:55.084393 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-94bb9c21-ee29-44ff-9179-7223e02ceac7 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:55.085196 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-94bb9c21-ee29-44ff-9179-7223e02ceac7 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:55.085633 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-94bb9c21-ee29-44ff-9179-7223e02ceac7 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:55.116122 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e6948567-eac1-4253-85bd-16fe9b8b3302 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:55.116819 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e6948567-eac1-4253-85bd-16fe9b8b3302 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:55.123436 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e6948567-eac1-4253-85bd-16fe9b8b3302 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:55.124163 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e6948567-eac1-4253-85bd-16fe9b8b3302 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:55.126026 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e6948567-eac1-4253-85bd-16fe9b8b3302 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:55.126575 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e6948567-eac1-4253-85bd-16fe9b8b3302 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:55.317611 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-94bb9c21-ee29-44ff-9179-7223e02ceac7 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:55.326528 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-94bb9c21-ee29-44ff-9179-7223e02ceac7 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1314 microversion: 2.1 time: 0.254867 Jun 22 08:59:55.336415 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-e6948567-eac1-4253-85bd-16fe9b8b3302 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:55.349574 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 169/366] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:55 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:55.359860 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e6948567-eac1-4253-85bd-16fe9b8b3302 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1522 microversion: 2.1 time: 0.246981 Jun 22 08:59:55.360060 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-63b860af-91e8-4e5d-9a31-eaed55bbf813 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:55.360658 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-63b860af-91e8-4e5d-9a31-eaed55bbf813 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:55.362766 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 198/367] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:55 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:55.367873 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-63b860af-91e8-4e5d-9a31-eaed55bbf813 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:55.368597 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-63b860af-91e8-4e5d-9a31-eaed55bbf813 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:55.369533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-63b860af-91e8-4e5d-9a31-eaed55bbf813 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:55.370112 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-63b860af-91e8-4e5d-9a31-eaed55bbf813 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:55.381354 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-34660263-f8ab-4c1e-b746-e84bc8e3c8d5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:55.382922 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-34660263-f8ab-4c1e-b746-e84bc8e3c8d5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:55.390655 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-34660263-f8ab-4c1e-b746-e84bc8e3c8d5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:55.391422 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-34660263-f8ab-4c1e-b746-e84bc8e3c8d5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:55.392559 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-34660263-f8ab-4c1e-b746-e84bc8e3c8d5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:55.393220 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-34660263-f8ab-4c1e-b746-e84bc8e3c8d5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:55.602573 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-63b860af-91e8-4e5d-9a31-eaed55bbf813 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:55.609756 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-34660263-f8ab-4c1e-b746-e84bc8e3c8d5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:55.618232 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-34660263-f8ab-4c1e-b746-e84bc8e3c8d5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1319 microversion: 2.1 time: 0.243562 Jun 22 08:59:55.618635 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-63b860af-91e8-4e5d-9a31-eaed55bbf813 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1553 microversion: 2.1 time: 0.267392 Jun 22 08:59:55.619211 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 170/368] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:55 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1553 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:55.621569 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 199/369] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:55 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:55.863821 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [req-da36d585-e7b0-40a1-9d29-f8ec4ea4781b req-8ec8ab0f-8217-4c74-9543-a6f18b09d040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eefd03e-9e6e-4710-b228-b87c5ddf475f", "name": "network-vif-deleted", "tag": "7e660c9a-428c-40ae-95a2-99c74d79d984"}]} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:59:55.863821 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-da36d585-e7b0-40a1-9d29-f8ec4ea4781b req-8ec8ab0f-8217-4c74-9543-a6f18b09d040 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:55.863821 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-da36d585-e7b0-40a1-9d29-f8ec4ea4781b req-8ec8ab0f-8217-4c74-9543-a6f18b09d040 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:55.871528 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.compute.server_external_events [req-da36d585-e7b0-40a1-9d29-f8ec4ea4781b req-8ec8ab0f-8217-4c74-9543-a6f18b09d040 service nova] Creating event network-vif-deleted:7e660c9a-428c-40ae-95a2-99c74d79d984 for instance 8eefd03e-9e6e-4710-b228-b87c5ddf475f on hv-cinder-84599 Jun 22 08:59:55.877730 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [req-da36d585-e7b0-40a1-9d29-f8ec4ea4781b req-8ec8ab0f-8217-4c74-9543-a6f18b09d040 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034390 Jun 22 08:59:55.878362 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 171/370] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 08:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:59:56.363894 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-6c43edd1-c28f-4b65-8187-3395099d14aa tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:56.364518 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-6c43edd1-c28f-4b65-8187-3395099d14aa tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:56.372251 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6c43edd1-c28f-4b65-8187-3395099d14aa tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:56.372251 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6c43edd1-c28f-4b65-8187-3395099d14aa tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:56.372251 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6c43edd1-c28f-4b65-8187-3395099d14aa tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:56.372544 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6c43edd1-c28f-4b65-8187-3395099d14aa tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:56.379875 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-d49fa13d-e67b-4b5d-afeb-a9d597166445 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:56.380571 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-d49fa13d-e67b-4b5d-afeb-a9d597166445 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:56.386842 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d49fa13d-e67b-4b5d-afeb-a9d597166445 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:56.387290 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d49fa13d-e67b-4b5d-afeb-a9d597166445 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:56.388124 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d49fa13d-e67b-4b5d-afeb-a9d597166445 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:56.388735 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d49fa13d-e67b-4b5d-afeb-a9d597166445 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:56.568524 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-6c43edd1-c28f-4b65-8187-3395099d14aa tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:56.582277 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-6c43edd1-c28f-4b65-8187-3395099d14aa tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1314 microversion: 2.1 time: 0.216153 Jun 22 08:59:56.582277 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 200/371] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:56 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:56.582697 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-d49fa13d-e67b-4b5d-afeb-a9d597166445 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:56.586446 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-d49fa13d-e67b-4b5d-afeb-a9d597166445 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1522 microversion: 2.1 time: 0.211833 Jun 22 08:59:56.586989 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 172/372] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:56 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:56.636172 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-809883e3-28ad-4601-bd66-41444f8bc260 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:56.642180 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-809883e3-28ad-4601-bd66-41444f8bc260 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:56.642309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-fbb4c808-e352-46d8-9d63-fcb77d978c92 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:56.642309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-fbb4c808-e352-46d8-9d63-fcb77d978c92 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:56.643920 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-809883e3-28ad-4601-bd66-41444f8bc260 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:56.644066 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fbb4c808-e352-46d8-9d63-fcb77d978c92 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:56.644371 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-809883e3-28ad-4601-bd66-41444f8bc260 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:56.644515 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fbb4c808-e352-46d8-9d63-fcb77d978c92 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:56.645165 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-809883e3-28ad-4601-bd66-41444f8bc260 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:56.645295 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fbb4c808-e352-46d8-9d63-fcb77d978c92 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:56.645603 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-809883e3-28ad-4601-bd66-41444f8bc260 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:56.645730 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fbb4c808-e352-46d8-9d63-fcb77d978c92 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:56.743671 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-809883e3-28ad-4601-bd66-41444f8bc260 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:56.752315 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-809883e3-28ad-4601-bd66-41444f8bc260 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1511 microversion: 2.1 time: 0.119979 Jun 22 08:59:56.753097 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 173/373] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:56 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1511 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:56.809039 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-fbb4c808-e352-46d8-9d63-fcb77d978c92 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:56.817489 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-fbb4c808-e352-46d8-9d63-fcb77d978c92 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1319 microversion: 2.1 time: 0.184615 Jun 22 08:59:56.818043 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 201/374] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:56 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:57.597494 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-5f5a50fe-f7ea-46f1-9cb6-b06962110bf7 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:57.598192 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-5f5a50fe-f7ea-46f1-9cb6-b06962110bf7 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:57.603106 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-19d12c26-7a3f-4bdf-9b31-b89df9951ff4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:57.603788 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-19d12c26-7a3f-4bdf-9b31-b89df9951ff4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:57.604954 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5f5a50fe-f7ea-46f1-9cb6-b06962110bf7 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:57.605410 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5f5a50fe-f7ea-46f1-9cb6-b06962110bf7 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:57.606182 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5f5a50fe-f7ea-46f1-9cb6-b06962110bf7 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:57.606621 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5f5a50fe-f7ea-46f1-9cb6-b06962110bf7 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:57.609982 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-19d12c26-7a3f-4bdf-9b31-b89df9951ff4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:57.610428 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-19d12c26-7a3f-4bdf-9b31-b89df9951ff4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:57.610967 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:57.611183 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-19d12c26-7a3f-4bdf-9b31-b89df9951ff4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:57.611787 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-19d12c26-7a3f-4bdf-9b31-b89df9951ff4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:57.804041 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-5f5a50fe-f7ea-46f1-9cb6-b06962110bf7 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:57.813078 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-5f5a50fe-f7ea-46f1-9cb6-b06962110bf7 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1314 microversion: 2.1 time: 0.220095 Jun 22 08:59:57.813646 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 174/375] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:57 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:57.819247 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-19d12c26-7a3f-4bdf-9b31-b89df9951ff4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:57.825484 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c52a8872-623b-42b1-9515-861ef7f514c3 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:57.826095 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c52a8872-623b-42b1-9515-861ef7f514c3 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:57.832296 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c52a8872-623b-42b1-9515-861ef7f514c3 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:57.832850 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c52a8872-623b-42b1-9515-861ef7f514c3 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:57.833466 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-19d12c26-7a3f-4bdf-9b31-b89df9951ff4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1522 microversion: 2.1 time: 0.234223 Jun 22 08:59:57.833830 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c52a8872-623b-42b1-9515-861ef7f514c3 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:57.834047 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 202/376] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:57 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:57.834405 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c52a8872-623b-42b1-9515-861ef7f514c3 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:57.839025 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f6f061d6-cb78-4bbf-9553-03f41f714cf2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:57.842200 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-f6f061d6-cb78-4bbf-9553-03f41f714cf2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:57.846622 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f6f061d6-cb78-4bbf-9553-03f41f714cf2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:57.847074 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f6f061d6-cb78-4bbf-9553-03f41f714cf2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:57.847841 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f6f061d6-cb78-4bbf-9553-03f41f714cf2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:57.848280 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f6f061d6-cb78-4bbf-9553-03f41f714cf2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:57.899867 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-c52a8872-623b-42b1-9515-861ef7f514c3 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:57.908235 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c52a8872-623b-42b1-9515-861ef7f514c3 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1511 microversion: 2.1 time: 0.093615 Jun 22 08:59:57.908827 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 175/377] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:57 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1511 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:57.998188 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-f6f061d6-cb78-4bbf-9553-03f41f714cf2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:58.006649 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f6f061d6-cb78-4bbf-9553-03f41f714cf2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1319 microversion: 2.1 time: 0.171634 Jun 22 08:59:58.008808 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 203/378] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:57 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:58.831363 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-d40da4e8-f19d-49ca-870c-d143feb22b64 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:58.831973 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-d40da4e8-f19d-49ca-870c-d143feb22b64 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:58.839323 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d40da4e8-f19d-49ca-870c-d143feb22b64 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:58.839773 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d40da4e8-f19d-49ca-870c-d143feb22b64 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:58.840540 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d40da4e8-f19d-49ca-870c-d143feb22b64 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:58.841011 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d40da4e8-f19d-49ca-870c-d143feb22b64 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:58.849871 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2c8eba88-a52f-4946-947b-f8d9c014be1c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:58.850784 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2c8eba88-a52f-4946-947b-f8d9c014be1c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:58.857308 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2c8eba88-a52f-4946-947b-f8d9c014be1c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:58.857765 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2c8eba88-a52f-4946-947b-f8d9c014be1c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:58.858846 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2c8eba88-a52f-4946-947b-f8d9c014be1c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:58.859626 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2c8eba88-a52f-4946-947b-f8d9c014be1c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:59.048428 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-d40da4e8-f19d-49ca-870c-d143feb22b64 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:59.055481 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-2c8eba88-a52f-4946-947b-f8d9c014be1c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:59.057594 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-d40da4e8-f19d-49ca-870c-d143feb22b64 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1314 microversion: 2.1 time: 0.231019 Jun 22 08:59:59.058412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 176/379] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:58 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:59.063782 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-130315cc-c972-42de-a830-5beb472deda8 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:59.065031 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-130315cc-c972-42de-a830-5beb472deda8 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:59.065368 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2c8eba88-a52f-4946-947b-f8d9c014be1c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1522 microversion: 2.1 time: 0.219214 Jun 22 08:59:59.066177 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 204/380] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:58 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:59:59.071852 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-dfad93c7-ad09-4760-8a95-dfb18d03cad5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:59.072493 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-dfad93c7-ad09-4760-8a95-dfb18d03cad5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 08:59:59.079396 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dfad93c7-ad09-4760-8a95-dfb18d03cad5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:59.079849 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dfad93c7-ad09-4760-8a95-dfb18d03cad5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:59.079991 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-130315cc-c972-42de-a830-5beb472deda8 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:59.080620 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-130315cc-c972-42de-a830-5beb472deda8 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:59.080722 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dfad93c7-ad09-4760-8a95-dfb18d03cad5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:59.081096 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dfad93c7-ad09-4760-8a95-dfb18d03cad5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:59.081422 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-130315cc-c972-42de-a830-5beb472deda8 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:59.081860 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-130315cc-c972-42de-a830-5beb472deda8 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:59.170253 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-130315cc-c972-42de-a830-5beb472deda8 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:59.178797 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-130315cc-c972-42de-a830-5beb472deda8 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1345 microversion: 2.1 time: 0.119059 Jun 22 08:59:59.179598 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 177/381] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:59 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1345 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:59.237600 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-dfad93c7-ad09-4760-8a95-dfb18d03cad5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 08:59:59.245096 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-dfad93c7-ad09-4760-8a95-dfb18d03cad5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1319 microversion: 2.1 time: 0.177692 Jun 22 08:59:59.245662 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 205/382] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 08:59:59 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:00.075442 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a3fe255b-9f2c-4492-aea3-e5546c118359 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:00.076461 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a3fe255b-9f2c-4492-aea3-e5546c118359 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:00.081819 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d4a8053b-cb3b-440c-a093-d276846dfc5c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:00.082957 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-d4a8053b-cb3b-440c-a093-d276846dfc5c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:00.083747 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a3fe255b-9f2c-4492-aea3-e5546c118359 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:00.084269 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a3fe255b-9f2c-4492-aea3-e5546c118359 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:00.085146 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a3fe255b-9f2c-4492-aea3-e5546c118359 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:00.085650 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a3fe255b-9f2c-4492-aea3-e5546c118359 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:00.089053 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d4a8053b-cb3b-440c-a093-d276846dfc5c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:00.089503 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d4a8053b-cb3b-440c-a093-d276846dfc5c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:00.097975 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d4a8053b-cb3b-440c-a093-d276846dfc5c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:00.098860 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d4a8053b-cb3b-440c-a093-d276846dfc5c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:00.293625 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-a3fe255b-9f2c-4492-aea3-e5546c118359 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:00.295744 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-d4a8053b-cb3b-440c-a093-d276846dfc5c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:00.299395 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=100 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:00.301338 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a3fe255b-9f2c-4492-aea3-e5546c118359 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1314 microversion: 2.1 time: 0.229833 Jun 22 09:00:00.301911 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 178/383] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:00 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:00.306324 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c3600e19-9065-4681-b8c9-6c886a79c1a0 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:00.307082 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c3600e19-9065-4681-b8c9-6c886a79c1a0 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:00.307218 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d4a8053b-cb3b-440c-a093-d276846dfc5c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1522 microversion: 2.1 time: 0.229640 Jun 22 09:00:00.307668 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 206/384] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:00 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:00.313910 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c3600e19-9065-4681-b8c9-6c886a79c1a0 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:00.314484 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c3600e19-9065-4681-b8c9-6c886a79c1a0 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:00.315533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c3600e19-9065-4681-b8c9-6c886a79c1a0 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:00.315964 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c3600e19-9065-4681-b8c9-6c886a79c1a0 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:00.321848 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-12fb8fee-a660-4f08-8601-9babea2c5775 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:00.322529 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-12fb8fee-a660-4f08-8601-9babea2c5775 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:00.330728 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-12fb8fee-a660-4f08-8601-9babea2c5775 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:00.331194 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-12fb8fee-a660-4f08-8601-9babea2c5775 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:00.331983 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-12fb8fee-a660-4f08-8601-9babea2c5775 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:00.332429 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-12fb8fee-a660-4f08-8601-9babea2c5775 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:00.387556 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-c3600e19-9065-4681-b8c9-6c886a79c1a0 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:00.396410 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c3600e19-9065-4681-b8c9-6c886a79c1a0 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1345 microversion: 2.1 time: 0.093504 Jun 22 09:00:00.397046 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 179/385] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:00 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1345 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:00.485094 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-12fb8fee-a660-4f08-8601-9babea2c5775 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:00.492519 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-12fb8fee-a660-4f08-8601-9babea2c5775 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1319 microversion: 2.1 time: 0.182928 Jun 22 09:00:00.493117 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 207/386] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:00 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:01.318331 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-61a6d714-ae7e-4abf-a4ef-0fc301301d9b tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:01.321618 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-61a6d714-ae7e-4abf-a4ef-0fc301301d9b tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:01.325794 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-61a6d714-ae7e-4abf-a4ef-0fc301301d9b tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:01.325916 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-16772b4e-7277-455a-b553-dcf625184904 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:01.326350 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-61a6d714-ae7e-4abf-a4ef-0fc301301d9b tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:01.326584 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-16772b4e-7277-455a-b553-dcf625184904 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:01.326996 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-61a6d714-ae7e-4abf-a4ef-0fc301301d9b tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:01.327940 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-61a6d714-ae7e-4abf-a4ef-0fc301301d9b tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:01.334342 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-16772b4e-7277-455a-b553-dcf625184904 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:01.335014 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-16772b4e-7277-455a-b553-dcf625184904 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:01.335811 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-16772b4e-7277-455a-b553-dcf625184904 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:01.336289 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-16772b4e-7277-455a-b553-dcf625184904 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:01.543341 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-16772b4e-7277-455a-b553-dcf625184904 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:01.555608 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-61a6d714-ae7e-4abf-a4ef-0fc301301d9b tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:01.557464 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-16772b4e-7277-455a-b553-dcf625184904 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1522 microversion: 2.1 time: 0.232867 Jun 22 09:00:01.563830 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-61a6d714-ae7e-4abf-a4ef-0fc301301d9b tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1314 microversion: 2.1 time: 0.249243 Jun 22 09:00:01.573452 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 180/387] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:01 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:01.573452 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a9af18c0-9e2a-4558-936d-4791f6f03d25 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:01.573452 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a9af18c0-9e2a-4558-936d-4791f6f03d25 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:01.573828 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 208/388] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:01 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:01.578404 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a9af18c0-9e2a-4558-936d-4791f6f03d25 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:01.578606 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-654f9296-a40e-4e2c-9d3d-6d239aa39bd3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:01.578850 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a9af18c0-9e2a-4558-936d-4791f6f03d25 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:01.579861 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a9af18c0-9e2a-4558-936d-4791f6f03d25 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:01.581064 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a9af18c0-9e2a-4558-936d-4791f6f03d25 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:01.581948 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-654f9296-a40e-4e2c-9d3d-6d239aa39bd3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:01.589972 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-654f9296-a40e-4e2c-9d3d-6d239aa39bd3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:01.590802 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-654f9296-a40e-4e2c-9d3d-6d239aa39bd3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:01.592387 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-654f9296-a40e-4e2c-9d3d-6d239aa39bd3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:01.593643 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-654f9296-a40e-4e2c-9d3d-6d239aa39bd3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:01.651499 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-a9af18c0-9e2a-4558-936d-4791f6f03d25 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:01.660464 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a9af18c0-9e2a-4558-936d-4791f6f03d25 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1345 microversion: 2.1 time: 0.094213 Jun 22 09:00:01.661427 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 181/389] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:01 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1345 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:01.666157 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [req-8c730798-ba7a-41c8-84ee-19f6a832fd24 req-59e763b5-62ac-4232-b9c5-72e7f772c1b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcee9695-f963-4f49-a7c9-5ec8625273cf", "name": "network-vif-plugged", "status": "completed", "tag": "7ba885ec-f8db-4e7a-8345-1e4ec200323b"}]} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:01.675003 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-8c730798-ba7a-41c8-84ee-19f6a832fd24 req-59e763b5-62ac-4232-b9c5-72e7f772c1b0 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:01.675452 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-8c730798-ba7a-41c8-84ee-19f6a832fd24 req-59e763b5-62ac-4232-b9c5-72e7f772c1b0 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:01.688037 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.compute.server_external_events [req-8c730798-ba7a-41c8-84ee-19f6a832fd24 req-59e763b5-62ac-4232-b9c5-72e7f772c1b0 service nova] Creating event network-vif-plugged:7ba885ec-f8db-4e7a-8345-1e4ec200323b for instance fcee9695-f963-4f49-a7c9-5ec8625273cf on hv-cinder-84599 Jun 22 09:00:01.692923 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [req-8c730798-ba7a-41c8-84ee-19f6a832fd24 req-59e763b5-62ac-4232-b9c5-72e7f772c1b0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030109 Jun 22 09:00:01.693524 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 182/390] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:01.763501 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-654f9296-a40e-4e2c-9d3d-6d239aa39bd3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:01.772064 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-654f9296-a40e-4e2c-9d3d-6d239aa39bd3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1319 microversion: 2.1 time: 0.199488 Jun 22 09:00:01.772637 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 209/391] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:01 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:02.579857 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-cd8ba870-7a50-4ec6-92fc-aeb3d2e3c828 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:02.580629 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-acf3379d-f3f8-40d1-ada6-9e4c310bb964 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:02.581102 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-cd8ba870-7a50-4ec6-92fc-aeb3d2e3c828 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:02.581977 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-acf3379d-f3f8-40d1-ada6-9e4c310bb964 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:02.587557 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cd8ba870-7a50-4ec6-92fc-aeb3d2e3c828 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:02.587821 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cd8ba870-7a50-4ec6-92fc-aeb3d2e3c828 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:02.588604 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-acf3379d-f3f8-40d1-ada6-9e4c310bb964 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:02.588688 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cd8ba870-7a50-4ec6-92fc-aeb3d2e3c828 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:02.589027 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-acf3379d-f3f8-40d1-ada6-9e4c310bb964 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:02.589130 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cd8ba870-7a50-4ec6-92fc-aeb3d2e3c828 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:02.589795 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-acf3379d-f3f8-40d1-ada6-9e4c310bb964 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:02.590265 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-acf3379d-f3f8-40d1-ada6-9e4c310bb964 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:02.792173 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-acf3379d-f3f8-40d1-ada6-9e4c310bb964 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:02.797122 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-cd8ba870-7a50-4ec6-92fc-aeb3d2e3c828 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:02.801218 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-acf3379d-f3f8-40d1-ada6-9e4c310bb964 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1314 microversion: 2.1 time: 0.224256 Jun 22 09:00:02.801899 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 210/392] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:02 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:02.805325 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-cd8ba870-7a50-4ec6-92fc-aeb3d2e3c828 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1522 microversion: 2.1 time: 0.230890 Jun 22 09:00:02.805965 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 183/393] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:02 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:02.815074 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-7d6e6692-b795-4bde-a46f-42a04818d185 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:02.815074 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-7d6e6692-b795-4bde-a46f-42a04818d185 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:02.819009 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7d671082-ae8b-400a-8517-7f18d06a55b6 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:02.819009 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7d671082-ae8b-400a-8517-7f18d06a55b6 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:02.819224 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7d6e6692-b795-4bde-a46f-42a04818d185 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:02.819224 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7d6e6692-b795-4bde-a46f-42a04818d185 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:02.819224 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7d6e6692-b795-4bde-a46f-42a04818d185 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:02.819224 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7d6e6692-b795-4bde-a46f-42a04818d185 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:02.823065 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7d671082-ae8b-400a-8517-7f18d06a55b6 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:02.823518 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7d671082-ae8b-400a-8517-7f18d06a55b6 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:02.824290 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7d671082-ae8b-400a-8517-7f18d06a55b6 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:02.824852 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7d671082-ae8b-400a-8517-7f18d06a55b6 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:02.910322 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7d671082-ae8b-400a-8517-7f18d06a55b6 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:02.919294 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7d671082-ae8b-400a-8517-7f18d06a55b6 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1345 microversion: 2.1 time: 0.107102 Jun 22 09:00:02.920203 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 211/394] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:02 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1345 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:02.976804 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-7d6e6692-b795-4bde-a46f-42a04818d185 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:02.984514 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-7d6e6692-b795-4bde-a46f-42a04818d185 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1319 microversion: 2.1 time: 0.177357 Jun 22 09:00:02.985305 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 184/395] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:02 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:03.818889 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-babf9721-20b7-4218-963f-4565974e2560 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:03.819543 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-babf9721-20b7-4218-963f-4565974e2560 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:03.822510 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-125c6aa8-fa54-4a47-8a5c-171ba827ba22 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:03.823124 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-125c6aa8-fa54-4a47-8a5c-171ba827ba22 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:03.825692 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-babf9721-20b7-4218-963f-4565974e2560 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:03.826141 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-babf9721-20b7-4218-963f-4565974e2560 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:03.826943 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-babf9721-20b7-4218-963f-4565974e2560 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:03.827806 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-babf9721-20b7-4218-963f-4565974e2560 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:03.829951 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-125c6aa8-fa54-4a47-8a5c-171ba827ba22 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:03.830401 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-125c6aa8-fa54-4a47-8a5c-171ba827ba22 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:03.831208 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-125c6aa8-fa54-4a47-8a5c-171ba827ba22 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:03.831626 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-125c6aa8-fa54-4a47-8a5c-171ba827ba22 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:04.031759 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-babf9721-20b7-4218-963f-4565974e2560 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:04.032823 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-125c6aa8-fa54-4a47-8a5c-171ba827ba22 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:04.036622 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-babf9721-20b7-4218-963f-4565974e2560 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1314 microversion: 2.1 time: 0.221737 Jun 22 09:00:04.037283 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 212/396] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:03 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:04.041684 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-bf04f1c3-a4b9-4fe8-8424-600e397e7f02 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:04.042285 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-bf04f1c3-a4b9-4fe8-8424-600e397e7f02 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:04.049104 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bf04f1c3-a4b9-4fe8-8424-600e397e7f02 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:04.049553 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bf04f1c3-a4b9-4fe8-8424-600e397e7f02 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:04.050320 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bf04f1c3-a4b9-4fe8-8424-600e397e7f02 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:04.050549 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-125c6aa8-fa54-4a47-8a5c-171ba827ba22 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1522 microversion: 2.1 time: 0.231936 Jun 22 09:00:04.050756 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bf04f1c3-a4b9-4fe8-8424-600e397e7f02 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:04.051127 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 185/397] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:03 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:04.055650 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-9d49b01a-76e0-4683-b6a1-9b775bedc8a3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:04.056257 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-9d49b01a-76e0-4683-b6a1-9b775bedc8a3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:04.064618 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9d49b01a-76e0-4683-b6a1-9b775bedc8a3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:04.065141 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9d49b01a-76e0-4683-b6a1-9b775bedc8a3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:04.065973 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9d49b01a-76e0-4683-b6a1-9b775bedc8a3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:04.066333 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9d49b01a-76e0-4683-b6a1-9b775bedc8a3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:04.092550 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bf04f1c3-a4b9-4fe8-8424-600e397e7f02 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:04.093633 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bf04f1c3-a4b9-4fe8-8424-600e397e7f02 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:04.094082 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.objects.instance [None req-bf04f1c3-a4b9-4fe8-8424-600e397e7f02 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lazy-loading 'fault' on Instance uuid 8eefd03e-9e6e-4710-b228-b87c5ddf475f {{(pid=118025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:00:04.160768 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-bf04f1c3-a4b9-4fe8-8424-600e397e7f02 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:04.169439 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-bf04f1c3-a4b9-4fe8-8424-600e397e7f02 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1350 microversion: 2.1 time: 0.131086 Jun 22 09:00:04.169922 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 213/398] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:04 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1350 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:04.224483 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-9d49b01a-76e0-4683-b6a1-9b775bedc8a3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:04.232895 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-9d49b01a-76e0-4683-b6a1-9b775bedc8a3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1319 microversion: 2.1 time: 0.180732 Jun 22 09:00:04.234298 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 186/399] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:04 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:05.054672 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9ca6e336-38f4-43de-802b-b4739d19ea00 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:05.055309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9ca6e336-38f4-43de-802b-b4739d19ea00 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:05.064062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9ca6e336-38f4-43de-802b-b4739d19ea00 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:05.064828 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9ca6e336-38f4-43de-802b-b4739d19ea00 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:05.066239 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9ca6e336-38f4-43de-802b-b4739d19ea00 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:05.066650 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9ca6e336-38f4-43de-802b-b4739d19ea00 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:05.070959 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-0962a941-bc45-4e80-a607-67e30e0c191b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:05.070959 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-0962a941-bc45-4e80-a607-67e30e0c191b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:05.078295 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0962a941-bc45-4e80-a607-67e30e0c191b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:05.078742 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0962a941-bc45-4e80-a607-67e30e0c191b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:05.079505 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0962a941-bc45-4e80-a607-67e30e0c191b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:05.079938 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0962a941-bc45-4e80-a607-67e30e0c191b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:05.292638 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9ca6e336-38f4-43de-802b-b4739d19ea00 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:05.294785 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-0962a941-bc45-4e80-a607-67e30e0c191b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:05.303148 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9ca6e336-38f4-43de-802b-b4739d19ea00 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1314 microversion: 2.1 time: 0.252404 Jun 22 09:00:05.303993 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 214/400] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:05 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:05.310338 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-b45cb7a4-968f-4e58-b0ef-20f99cb3820c tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:05.310553 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-0962a941-bc45-4e80-a607-67e30e0c191b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1522 microversion: 2.1 time: 0.245693 Jun 22 09:00:05.318089 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 187/401] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:05 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:05.318089 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-4bb0f77d-d42a-4747-b487-4a12bab92c10 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:05.318089 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-4bb0f77d-d42a-4747-b487-4a12bab92c10 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:05.318401 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-b45cb7a4-968f-4e58-b0ef-20f99cb3820c tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:05.323368 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4bb0f77d-d42a-4747-b487-4a12bab92c10 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:05.323808 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4bb0f77d-d42a-4747-b487-4a12bab92c10 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:05.324595 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4bb0f77d-d42a-4747-b487-4a12bab92c10 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:05.325051 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4bb0f77d-d42a-4747-b487-4a12bab92c10 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:05.325240 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b45cb7a4-968f-4e58-b0ef-20f99cb3820c tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:05.325718 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b45cb7a4-968f-4e58-b0ef-20f99cb3820c tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:05.326488 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b45cb7a4-968f-4e58-b0ef-20f99cb3820c tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:05.326997 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b45cb7a4-968f-4e58-b0ef-20f99cb3820c tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:05.356858 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b45cb7a4-968f-4e58-b0ef-20f99cb3820c tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:05.357306 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b45cb7a4-968f-4e58-b0ef-20f99cb3820c tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:05.357751 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.objects.instance [None req-b45cb7a4-968f-4e58-b0ef-20f99cb3820c tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lazy-loading 'fault' on Instance uuid 8eefd03e-9e6e-4710-b228-b87c5ddf475f {{(pid=118025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:00:05.419592 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-b45cb7a4-968f-4e58-b0ef-20f99cb3820c tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:05.428289 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-b45cb7a4-968f-4e58-b0ef-20f99cb3820c tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1350 microversion: 2.1 time: 0.122040 Jun 22 09:00:05.428882 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 215/402] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:05 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1350 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:05.485461 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-4bb0f77d-d42a-4747-b487-4a12bab92c10 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:05.492805 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-4bb0f77d-d42a-4747-b487-4a12bab92c10 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1319 microversion: 2.1 time: 0.179869 Jun 22 09:00:05.493365 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 188/403] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:05 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:05.859980 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-87973826-fe2f-420a-bda5-23ffb7e02fbe req-d42d76e3-e6ec-4f8c-9512-b60281fb52b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c80904-64ab-4f87-98d3-89784b0b0f96", "name": "network-vif-plugged", "status": "completed", "tag": "a3085c34-2f17-4743-8ee5-dda470978f80"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:05.868324 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-87973826-fe2f-420a-bda5-23ffb7e02fbe req-d42d76e3-e6ec-4f8c-9512-b60281fb52b7 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:05.868771 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-87973826-fe2f-420a-bda5-23ffb7e02fbe req-d42d76e3-e6ec-4f8c-9512-b60281fb52b7 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:05.879748 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-87973826-fe2f-420a-bda5-23ffb7e02fbe req-d42d76e3-e6ec-4f8c-9512-b60281fb52b7 service nova] Creating event network-vif-plugged:a3085c34-2f17-4743-8ee5-dda470978f80 for instance f0c80904-64ab-4f87-98d3-89784b0b0f96 on hv-cinder-84599 Jun 22 09:00:05.884932 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-87973826-fe2f-420a-bda5-23ffb7e02fbe req-d42d76e3-e6ec-4f8c-9512-b60281fb52b7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028945 Jun 22 09:00:05.885514 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 216/404] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:06.324518 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1015abab-eccc-4fba-b7a3-61327d223edf tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:06.326333 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1015abab-eccc-4fba-b7a3-61327d223edf tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:06.330504 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-dc6b37a8-ef5c-4bdb-9770-a9822e9f0e5c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:06.332186 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-dc6b37a8-ef5c-4bdb-9770-a9822e9f0e5c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:06.335207 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1015abab-eccc-4fba-b7a3-61327d223edf tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:06.335657 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1015abab-eccc-4fba-b7a3-61327d223edf tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:06.336462 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1015abab-eccc-4fba-b7a3-61327d223edf tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:06.336925 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1015abab-eccc-4fba-b7a3-61327d223edf tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:06.339483 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dc6b37a8-ef5c-4bdb-9770-a9822e9f0e5c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:06.340013 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dc6b37a8-ef5c-4bdb-9770-a9822e9f0e5c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:06.340891 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dc6b37a8-ef5c-4bdb-9770-a9822e9f0e5c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:06.341400 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dc6b37a8-ef5c-4bdb-9770-a9822e9f0e5c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:06.529603 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-1015abab-eccc-4fba-b7a3-61327d223edf tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:06.539176 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-dc6b37a8-ef5c-4bdb-9770-a9822e9f0e5c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:06.539427 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1015abab-eccc-4fba-b7a3-61327d223edf tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1314 microversion: 2.1 time: 0.218618 Jun 22 09:00:06.539674 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 189/405] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:06 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:06.545279 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-dc6b37a8-ef5c-4bdb-9770-a9822e9f0e5c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1502 microversion: 2.1 time: 0.220294 Jun 22 09:00:06.545864 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 217/406] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:06 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1502 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:06.550639 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-26767550-4b63-46d1-9051-b7c2088f2876 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:06.551274 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-26767550-4b63-46d1-9051-b7c2088f2876 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:06.558270 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-26767550-4b63-46d1-9051-b7c2088f2876 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:06.558711 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-26767550-4b63-46d1-9051-b7c2088f2876 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:06.559121 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a80b9980-292d-49df-a540-0fb0858656f3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:06.559653 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-26767550-4b63-46d1-9051-b7c2088f2876 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:06.559865 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-a80b9980-292d-49df-a540-0fb0858656f3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:06.560095 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-26767550-4b63-46d1-9051-b7c2088f2876 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:06.566736 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a80b9980-292d-49df-a540-0fb0858656f3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:06.567227 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a80b9980-292d-49df-a540-0fb0858656f3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:06.567993 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a80b9980-292d-49df-a540-0fb0858656f3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:06.568433 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a80b9980-292d-49df-a540-0fb0858656f3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:06.591033 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-26767550-4b63-46d1-9051-b7c2088f2876 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:06.591386 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-26767550-4b63-46d1-9051-b7c2088f2876 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:06.591841 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.objects.instance [None req-26767550-4b63-46d1-9051-b7c2088f2876 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lazy-loading 'fault' on Instance uuid 8eefd03e-9e6e-4710-b228-b87c5ddf475f {{(pid=118024) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:00:06.659320 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-26767550-4b63-46d1-9051-b7c2088f2876 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:06.667172 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-26767550-4b63-46d1-9051-b7c2088f2876 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1350 microversion: 2.1 time: 0.126485 Jun 22 09:00:06.667730 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 190/407] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:06 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1350 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:06.672715 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-eac9a2b5-b988-4d99-b5fd-3817a7711762 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:06.673349 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-eac9a2b5-b988-4d99-b5fd-3817a7711762 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:06.679283 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-eac9a2b5-b988-4d99-b5fd-3817a7711762 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:06.679751 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-eac9a2b5-b988-4d99-b5fd-3817a7711762 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:06.680509 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-eac9a2b5-b988-4d99-b5fd-3817a7711762 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:06.680967 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-eac9a2b5-b988-4d99-b5fd-3817a7711762 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:06.683913 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=100 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:06.736132 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-a80b9980-292d-49df-a540-0fb0858656f3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:06.743570 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a80b9980-292d-49df-a540-0fb0858656f3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1319 microversion: 2.1 time: 0.188557 Jun 22 09:00:06.744130 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 218/408] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:06 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:06.820547 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-eac9a2b5-b988-4d99-b5fd-3817a7711762 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:06.828018 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-eac9a2b5-b988-4d99-b5fd-3817a7711762 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1515 microversion: 2.1 time: 0.159355 Jun 22 09:00:06.828582 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 191/409] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:06 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:07.556717 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-0389f7f2-6250-457c-94fc-1bb4aeee8c24 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:07.557356 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-0389f7f2-6250-457c-94fc-1bb4aeee8c24 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:07.559577 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=100 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:07.565631 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0389f7f2-6250-457c-94fc-1bb4aeee8c24 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:07.566077 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0389f7f2-6250-457c-94fc-1bb4aeee8c24 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:07.566844 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0389f7f2-6250-457c-94fc-1bb4aeee8c24 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:07.567283 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0389f7f2-6250-457c-94fc-1bb4aeee8c24 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:07.686129 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-8b2fae47-27ee-46dd-9522-70fe37e148ba tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:07.688018 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-8b2fae47-27ee-46dd-9522-70fe37e148ba tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:07.695165 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8b2fae47-27ee-46dd-9522-70fe37e148ba tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:07.699831 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8b2fae47-27ee-46dd-9522-70fe37e148ba tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:07.699831 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8b2fae47-27ee-46dd-9522-70fe37e148ba tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:07.699831 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8b2fae47-27ee-46dd-9522-70fe37e148ba tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:07.717680 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-0389f7f2-6250-457c-94fc-1bb4aeee8c24 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:07.729263 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-0389f7f2-6250-457c-94fc-1bb4aeee8c24 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1314 microversion: 2.1 time: 0.177437 Jun 22 09:00:07.730617 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 219/410] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:07 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:07.731801 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8b2fae47-27ee-46dd-9522-70fe37e148ba tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:07.732348 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8b2fae47-27ee-46dd-9522-70fe37e148ba tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:07.733030 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.objects.instance [None req-8b2fae47-27ee-46dd-9522-70fe37e148ba tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lazy-loading 'fault' on Instance uuid 8eefd03e-9e6e-4710-b228-b87c5ddf475f {{(pid=118024) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:00:07.760872 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-b9a48795-0cf9-4d42-8287-d45477cb7098 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:07.761494 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-b9a48795-0cf9-4d42-8287-d45477cb7098 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:07.768917 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b9a48795-0cf9-4d42-8287-d45477cb7098 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:07.769399 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b9a48795-0cf9-4d42-8287-d45477cb7098 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:07.770177 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b9a48795-0cf9-4d42-8287-d45477cb7098 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:07.770635 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b9a48795-0cf9-4d42-8287-d45477cb7098 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:07.775811 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-8b2fae47-27ee-46dd-9522-70fe37e148ba tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d27459025c40c5acdfd284ab338b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5502a8e1c8480aa5e683c73b112064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:07.784022 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-8b2fae47-27ee-46dd-9522-70fe37e148ba tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 200 len: 1350 microversion: 2.1 time: 0.103219 Jun 22 09:00:07.784597 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 192/411] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:07 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 1350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:07.902512 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-b9a48795-0cf9-4d42-8287-d45477cb7098 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:07.910248 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-b9a48795-0cf9-4d42-8287-d45477cb7098 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1319 microversion: 2.1 time: 0.153852 Jun 22 09:00:07.910806 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 220/412] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:07 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:08.746737 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1221d547-d2a5-4c54-a1f1-8149c0e47fe6 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:08.747377 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1221d547-d2a5-4c54-a1f1-8149c0e47fe6 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:08.754384 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1221d547-d2a5-4c54-a1f1-8149c0e47fe6 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:08.754828 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1221d547-d2a5-4c54-a1f1-8149c0e47fe6 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:08.755654 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1221d547-d2a5-4c54-a1f1-8149c0e47fe6 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:08.756106 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1221d547-d2a5-4c54-a1f1-8149c0e47fe6 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:08.801372 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-91a2c5ad-604d-4b96-b056-3d2f98305982 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:08.801983 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-91a2c5ad-604d-4b96-b056-3d2f98305982 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:08.808420 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-91a2c5ad-604d-4b96-b056-3d2f98305982 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:08.808902 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-91a2c5ad-604d-4b96-b056-3d2f98305982 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:08.809670 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-91a2c5ad-604d-4b96-b056-3d2f98305982 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:08.810114 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-91a2c5ad-604d-4b96-b056-3d2f98305982 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:08.825736 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.wsgi [None req-91a2c5ad-604d-4b96-b056-3d2f98305982 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] HTTP exception thrown: Instance 8eefd03e-9e6e-4710-b228-b87c5ddf475f could not be found. Jun 22 09:00:08.831445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-91a2c5ad-604d-4b96-b056-3d2f98305982 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Request method failure captured: Jun 22 09:00:08.831445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: request: GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f HTTP/1.1 Jun 22 09:00:08.831445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept: application/json Jun 22 09:00:08.831445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept-Encoding: identity Jun 22 09:00:08.831445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Connection: close Jun 22 09:00:08.831445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Length: 0 Jun 22 09:00:08.831445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Type: application/json Jun 22 09:00:08.831445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Host: 10.222.0.16 Jun 22 09:00:08.831445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Openstack-System-Scope: None Jun 22 09:00:08.831445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: User-Agent: python-urllib3/1.26.9 Jun 22 09:00:08.831445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Auth-Token: gAAAAABistmmV3E7NTIcJe9th2n1aSvuaXherPgKLUecSK2gxgC5ahtb8HNSWci4dDdie3MUJ6KSMib2frsVsDYWR5DqUtj4t1nQZdtzYoTAGq5KgG930cOq__7DgbVemosQyOvC2b0pyARD5Mb0JxePj6BsBDcI6mRRFp6_WGPOah59FRnmLCg Jun 22 09:00:08.831445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Id: None Jun 22 09:00:08.831445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Name: None Jun 22 09:00:08.831445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Identity-Status: Confirmed Jun 22 09:00:08.831445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Is-Admin-Project: True Jun 22 09:00:08.831445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Id: default Jun 22 09:00:08.831445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Name: Default Jun 22 09:00:08.831445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Id: 2c5502a8e1c8480aa5e683c73b112064 Jun 22 09:00:08.831445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Name: tempest-DeleteServersTestJSON-1045906520 Jun 22 09:00:08.831445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Role: member,reader Jun 22 09:00:08.831445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Roles: member,reader Jun 22 09:00:08.832684 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2c5502a8e1c8480aa5e683c73b112064"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2c5502a8e1c8480aa5e683c73b112064"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2c5502a8e1c8480aa5e683c73b112064"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2c5502a8e1c8480aa5e683c73b112064", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:00:08.832684 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant: tempest-DeleteServersTestJSON-1045906520 Jun 22 09:00:08.832684 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Id: 2c5502a8e1c8480aa5e683c73b112064 Jun 22 09:00:08.832684 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Name: tempest-DeleteServersTestJSON-1045906520 Jun 22 09:00:08.832684 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User: tempest-DeleteServersTestJSON-1045906520-project Jun 22 09:00:08.832684 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Id: default Jun 22 09:00:08.832684 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Name: Default Jun 22 09:00:08.832684 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Id: c0d27459025c40c5acdfd284ab338b1e Jun 22 09:00:08.832684 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Name: tempest-DeleteServersTestJSON-1045906520-project Jun 22 09:00:08.832684 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: method: > Jun 22 09:00:08.832684 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: exception: Instance 8eefd03e-9e6e-4710-b228-b87c5ddf475f could not be found. Jun 22 09:00:08.832684 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: action_args: {'id': '8eefd03e-9e6e-4710-b228-b87c5ddf475f'} Jun 22 09:00:08.833442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:00:08.833442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:08.833442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:00:08.833442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:00:08.833442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:00:08.833442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:00:08.833442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:00:08.833442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:00:08.833442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:00:08.833442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:00:08.833442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8eefd03e-9e6e-4710-b228-b87c5ddf475f could not be found. Jun 22 09:00:08.833442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:00:08.833442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:08.833442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:00:08.833442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:08.833442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:08.833442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:08.833442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:00:08.833442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:00:08.833442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:00:08.834740 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:00:08.834740 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:00:08.834740 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:00:08.834740 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:00:08.834740 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:00:08.834740 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:00:08.834740 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:00:08.834740 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8eefd03e-9e6e-4710-b228-b87c5ddf475f could not be found. Jun 22 09:00:08.834740 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:00:08.834740 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:08.834740 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:00:08.834740 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:08.834740 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:08.834740 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:08.834740 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:00:08.834740 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:00:08.834740 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8eefd03e-9e6e-4710-b228-b87c5ddf475f could not be found. Jun 22 09:00:08.834740 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:00:08.836618 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-91a2c5ad-604d-4b96-b056-3d2f98305982 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Returning 404 to user: Instance 8eefd03e-9e6e-4710-b228-b87c5ddf475f could not be found. {{(pid=118025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:00:08.836618 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-91a2c5ad-604d-4b96-b056-3d2f98305982 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 404 len: 111 microversion: 2.1 time: 0.036133 Jun 22 09:00:08.836618 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 221/413] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:08 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 09:00:08.887727 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-1221d547-d2a5-4c54-a1f1-8149c0e47fe6 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:08.896219 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1221d547-d2a5-4c54-a1f1-8149c0e47fe6 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1497 microversion: 2.1 time: 0.153579 Jun 22 09:00:08.896806 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 193/414] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:08 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:08.938758 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9f351820-914a-488d-9d62-a06081ce84f2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:08.939102 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9f351820-914a-488d-9d62-a06081ce84f2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:08.942624 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f2390732-c8ea-41dc-911b-d0ba3bf76a3e tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:08.943876 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f2390732-c8ea-41dc-911b-d0ba3bf76a3e tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:08.945557 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9f351820-914a-488d-9d62-a06081ce84f2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:08.948417 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9f351820-914a-488d-9d62-a06081ce84f2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:08.948417 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9f351820-914a-488d-9d62-a06081ce84f2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:08.948417 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9f351820-914a-488d-9d62-a06081ce84f2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:08.951276 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f2390732-c8ea-41dc-911b-d0ba3bf76a3e tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:08.951844 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f2390732-c8ea-41dc-911b-d0ba3bf76a3e tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:08.952620 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f2390732-c8ea-41dc-911b-d0ba3bf76a3e tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:08.953579 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f2390732-c8ea-41dc-911b-d0ba3bf76a3e tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:08.967339 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.wsgi [None req-f2390732-c8ea-41dc-911b-d0ba3bf76a3e tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] HTTP exception thrown: Instance 8eefd03e-9e6e-4710-b228-b87c5ddf475f could not be found. Jun 22 09:00:08.972080 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f2390732-c8ea-41dc-911b-d0ba3bf76a3e tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Request method failure captured: Jun 22 09:00:08.972080 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: request: GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f/os-volume_attachments HTTP/1.1 Jun 22 09:00:08.972080 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept: application/json Jun 22 09:00:08.972080 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept-Encoding: identity Jun 22 09:00:08.972080 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Connection: close Jun 22 09:00:08.972080 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Length: 0 Jun 22 09:00:08.972080 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Type: application/json Jun 22 09:00:08.972080 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Host: 10.222.0.16 Jun 22 09:00:08.972080 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Openstack-System-Scope: None Jun 22 09:00:08.972080 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: User-Agent: python-urllib3/1.26.9 Jun 22 09:00:08.972080 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Auth-Token: gAAAAABistmmV3E7NTIcJe9th2n1aSvuaXherPgKLUecSK2gxgC5ahtb8HNSWci4dDdie3MUJ6KSMib2frsVsDYWR5DqUtj4t1nQZdtzYoTAGq5KgG930cOq__7DgbVemosQyOvC2b0pyARD5Mb0JxePj6BsBDcI6mRRFp6_WGPOah59FRnmLCg Jun 22 09:00:08.972080 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Id: None Jun 22 09:00:08.972080 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Name: None Jun 22 09:00:08.972080 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Identity-Status: Confirmed Jun 22 09:00:08.972080 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Is-Admin-Project: True Jun 22 09:00:08.972080 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Id: default Jun 22 09:00:08.972080 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Name: Default Jun 22 09:00:08.972080 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Id: 2c5502a8e1c8480aa5e683c73b112064 Jun 22 09:00:08.972080 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Name: tempest-DeleteServersTestJSON-1045906520 Jun 22 09:00:08.972080 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Role: member,reader Jun 22 09:00:08.972080 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Roles: member,reader Jun 22 09:00:08.973412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2c5502a8e1c8480aa5e683c73b112064"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2c5502a8e1c8480aa5e683c73b112064"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2c5502a8e1c8480aa5e683c73b112064"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2c5502a8e1c8480aa5e683c73b112064", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:00:08.973412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant: tempest-DeleteServersTestJSON-1045906520 Jun 22 09:00:08.973412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Id: 2c5502a8e1c8480aa5e683c73b112064 Jun 22 09:00:08.973412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Name: tempest-DeleteServersTestJSON-1045906520 Jun 22 09:00:08.973412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User: tempest-DeleteServersTestJSON-1045906520-project Jun 22 09:00:08.973412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Id: default Jun 22 09:00:08.973412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Name: Default Jun 22 09:00:08.973412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Id: c0d27459025c40c5acdfd284ab338b1e Jun 22 09:00:08.973412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Name: tempest-DeleteServersTestJSON-1045906520-project Jun 22 09:00:08.973412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: method: > Jun 22 09:00:08.973412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: exception: Instance 8eefd03e-9e6e-4710-b228-b87c5ddf475f could not be found. Jun 22 09:00:08.973412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: action_args: {'server_id': '8eefd03e-9e6e-4710-b228-b87c5ddf475f'} Jun 22 09:00:08.974123 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:00:08.974123 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:08.974123 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:00:08.974123 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:00:08.974123 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:00:08.974123 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:00:08.974123 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:00:08.974123 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:00:08.974123 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:00:08.974123 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:00:08.974123 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8eefd03e-9e6e-4710-b228-b87c5ddf475f could not be found. Jun 22 09:00:08.974123 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:08.974123 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:08.974123 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:08.974123 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:08.974123 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:08.974123 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:08.974123 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:00:08.974123 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:00:08.974123 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:00:08.975265 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:00:08.975265 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 22 09:00:08.975265 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 09:00:08.975265 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 22 09:00:08.975265 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 09:00:08.975265 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 22 09:00:08.975265 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 22 09:00:08.975265 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:00:08.975265 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:00:08.975265 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8eefd03e-9e6e-4710-b228-b87c5ddf475f could not be found. Jun 22 09:00:08.975265 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:08.975265 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:08.975265 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:08.975265 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:08.975265 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:08.975265 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:08.975265 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:00:08.975265 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:00:08.975265 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8eefd03e-9e6e-4710-b228-b87c5ddf475f could not be found. Jun 22 09:00:08.975265 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:08.976327 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f2390732-c8ea-41dc-911b-d0ba3bf76a3e tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Returning 404 to user: Instance 8eefd03e-9e6e-4710-b228-b87c5ddf475f could not be found. {{(pid=118024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:00:08.976327 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f2390732-c8ea-41dc-911b-d0ba3bf76a3e tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035649 Jun 22 09:00:08.976327 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 194/415] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:00:08 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 09:00:09.084750 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9f351820-914a-488d-9d62-a06081ce84f2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:09.092216 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9f351820-914a-488d-9d62-a06081ce84f2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1319 microversion: 2.1 time: 0.161476 Jun 22 09:00:09.092769 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 222/416] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:08 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:09.514764 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-0b01cd98-924e-4f37-8f1a-6d6aeba982fe tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:09.519813 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-0b01cd98-924e-4f37-8f1a-6d6aeba982fe tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:09.521952 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0b01cd98-924e-4f37-8f1a-6d6aeba982fe tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:09.522464 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0b01cd98-924e-4f37-8f1a-6d6aeba982fe tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:09.523250 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0b01cd98-924e-4f37-8f1a-6d6aeba982fe tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:09.523688 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0b01cd98-924e-4f37-8f1a-6d6aeba982fe tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:09.546113 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.objects.instance [None req-0b01cd98-924e-4f37-8f1a-6d6aeba982fe tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lazy-loading 'flavor' on Instance uuid 713f284f-527e-4246-a442-f2d8a32428d5 {{(pid=118024) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:00:09.870404 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-0b01cd98-924e-4f37-8f1a-6d6aeba982fe tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "POST /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5/action" status: 200 len: 32 microversion: 2.1 time: 0.359780 Jun 22 09:00:09.871115 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 195/417] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jun 22 09:00:09 2022] POST /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5/action => generated 32 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 09:00:09.880916 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-43db34c2-472b-4678-8f39-bde630773533 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:09.881596 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-43db34c2-472b-4678-8f39-bde630773533 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:09.887649 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-43db34c2-472b-4678-8f39-bde630773533 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:09.888102 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-43db34c2-472b-4678-8f39-bde630773533 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:09.888898 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-43db34c2-472b-4678-8f39-bde630773533 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:09.889382 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-43db34c2-472b-4678-8f39-bde630773533 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:10.015553 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-43db34c2-472b-4678-8f39-bde630773533 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:10.023306 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-43db34c2-472b-4678-8f39-bde630773533 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.147164 Jun 22 09:00:10.023971 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 223/418] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:09 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:10.110543 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-8025a985-4737-49f2-bd63-eec9829d1a9d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:10.112213 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-8025a985-4737-49f2-bd63-eec9829d1a9d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:10.118763 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8025a985-4737-49f2-bd63-eec9829d1a9d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:10.119207 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8025a985-4737-49f2-bd63-eec9829d1a9d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:10.119981 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8025a985-4737-49f2-bd63-eec9829d1a9d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:10.120436 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8025a985-4737-49f2-bd63-eec9829d1a9d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:10.256234 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-8025a985-4737-49f2-bd63-eec9829d1a9d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:10.263852 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-8025a985-4737-49f2-bd63-eec9829d1a9d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1319 microversion: 2.1 time: 0.157691 Jun 22 09:00:10.264343 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 196/419] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:10 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:10.284844 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-986e3724-5daf-458e-9948-3c9036c92d87 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:10.285347 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-986e3724-5daf-458e-9948-3c9036c92d87 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:10.291589 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-986e3724-5daf-458e-9948-3c9036c92d87 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:10.292088 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-986e3724-5daf-458e-9948-3c9036c92d87 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:10.292884 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-986e3724-5daf-458e-9948-3c9036c92d87 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:10.293413 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-986e3724-5daf-458e-9948-3c9036c92d87 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:10.297400 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=100 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:10.319261 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-986e3724-5daf-458e-9948-3c9036c92d87 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Going to try to terminate instance {{(pid=118025) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:00:10.489840 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6dbd4b2e-fc9b-4038-b1c2-953085aee65c tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:10.490488 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-6dbd4b2e-fc9b-4038-b1c2-953085aee65c tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:10.496872 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6dbd4b2e-fc9b-4038-b1c2-953085aee65c tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:10.497320 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6dbd4b2e-fc9b-4038-b1c2-953085aee65c tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:10.498087 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6dbd4b2e-fc9b-4038-b1c2-953085aee65c tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:10.498523 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6dbd4b2e-fc9b-4038-b1c2-953085aee65c tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:10.512811 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.wsgi [None req-6dbd4b2e-fc9b-4038-b1c2-953085aee65c tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] HTTP exception thrown: Instance 8eefd03e-9e6e-4710-b228-b87c5ddf475f could not be found. Jun 22 09:00:10.515370 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6dbd4b2e-fc9b-4038-b1c2-953085aee65c tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Request method failure captured: Jun 22 09:00:10.515370 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: request: DELETE /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f HTTP/1.1 Jun 22 09:00:10.515370 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept: application/json Jun 22 09:00:10.515370 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept-Encoding: identity Jun 22 09:00:10.515370 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Connection: close Jun 22 09:00:10.515370 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Length: 0 Jun 22 09:00:10.515370 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Type: application/json Jun 22 09:00:10.515370 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Host: 10.222.0.16 Jun 22 09:00:10.515370 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Openstack-System-Scope: None Jun 22 09:00:10.515370 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: User-Agent: python-urllib3/1.26.9 Jun 22 09:00:10.515370 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Auth-Token: gAAAAABistmmV3E7NTIcJe9th2n1aSvuaXherPgKLUecSK2gxgC5ahtb8HNSWci4dDdie3MUJ6KSMib2frsVsDYWR5DqUtj4t1nQZdtzYoTAGq5KgG930cOq__7DgbVemosQyOvC2b0pyARD5Mb0JxePj6BsBDcI6mRRFp6_WGPOah59FRnmLCg Jun 22 09:00:10.515370 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Id: None Jun 22 09:00:10.515370 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Name: None Jun 22 09:00:10.515370 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Identity-Status: Confirmed Jun 22 09:00:10.515370 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Is-Admin-Project: True Jun 22 09:00:10.515370 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Id: default Jun 22 09:00:10.515370 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Name: Default Jun 22 09:00:10.515370 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Id: 2c5502a8e1c8480aa5e683c73b112064 Jun 22 09:00:10.515370 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Name: tempest-DeleteServersTestJSON-1045906520 Jun 22 09:00:10.515370 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Role: member,reader Jun 22 09:00:10.515370 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Roles: member,reader Jun 22 09:00:10.517434 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2c5502a8e1c8480aa5e683c73b112064"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2c5502a8e1c8480aa5e683c73b112064"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2c5502a8e1c8480aa5e683c73b112064"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2c5502a8e1c8480aa5e683c73b112064", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:00:10.517434 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant: tempest-DeleteServersTestJSON-1045906520 Jun 22 09:00:10.517434 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Id: 2c5502a8e1c8480aa5e683c73b112064 Jun 22 09:00:10.517434 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Name: tempest-DeleteServersTestJSON-1045906520 Jun 22 09:00:10.517434 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User: tempest-DeleteServersTestJSON-1045906520-project Jun 22 09:00:10.517434 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Id: default Jun 22 09:00:10.517434 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Name: Default Jun 22 09:00:10.517434 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Id: c0d27459025c40c5acdfd284ab338b1e Jun 22 09:00:10.517434 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Name: tempest-DeleteServersTestJSON-1045906520-project Jun 22 09:00:10.517434 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: method: > Jun 22 09:00:10.517434 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: exception: Instance 8eefd03e-9e6e-4710-b228-b87c5ddf475f could not be found. Jun 22 09:00:10.517434 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: action_args: {'id': '8eefd03e-9e6e-4710-b228-b87c5ddf475f'} Jun 22 09:00:10.518346 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:00:10.518346 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:10.518346 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:00:10.518346 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:00:10.518346 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:00:10.518346 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:00:10.518346 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:00:10.518346 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:00:10.518346 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:00:10.518346 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:00:10.518346 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8eefd03e-9e6e-4710-b228-b87c5ddf475f could not be found. Jun 22 09:00:10.518346 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:10.518346 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:10.518346 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:10.518346 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:10.518346 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:10.518346 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:10.518346 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:00:10.518346 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:00:10.518346 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:00:10.520122 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:00:10.520122 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 09:00:10.520122 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 09:00:10.520122 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 09:00:10.520122 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 09:00:10.520122 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:00:10.520122 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:00:10.520122 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:00:10.520122 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:00:10.520122 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8eefd03e-9e6e-4710-b228-b87c5ddf475f could not be found. Jun 22 09:00:10.520122 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:10.520122 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:10.520122 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:10.520122 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:10.520122 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:10.520122 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:10.520122 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:00:10.520122 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:00:10.520122 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8eefd03e-9e6e-4710-b228-b87c5ddf475f could not be found. Jun 22 09:00:10.520122 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:10.521494 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6dbd4b2e-fc9b-4038-b1c2-953085aee65c tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Returning 404 to user: Instance 8eefd03e-9e6e-4710-b228-b87c5ddf475f could not be found. {{(pid=118024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:00:10.521494 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-6dbd4b2e-fc9b-4038-b1c2-953085aee65c tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 404 len: 111 microversion: 2.1 time: 0.032798 Jun 22 09:00:10.521494 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 197/420] 10.222.0.16 () {58 vars in 1238 bytes} [Wed Jun 22 09:00:10 2022] DELETE /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 09:00:10.526834 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ba7eeafa-91f3-4bda-9afc-64099c898bd6 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:10.527445 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ba7eeafa-91f3-4bda-9afc-64099c898bd6 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] [instance: 8eefd03e-9e6e-4710-b228-b87c5ddf475f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:10.534237 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ba7eeafa-91f3-4bda-9afc-64099c898bd6 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:10.534693 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ba7eeafa-91f3-4bda-9afc-64099c898bd6 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:10.535541 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ba7eeafa-91f3-4bda-9afc-64099c898bd6 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:10.535980 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ba7eeafa-91f3-4bda-9afc-64099c898bd6 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:10.549625 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.wsgi [None req-ba7eeafa-91f3-4bda-9afc-64099c898bd6 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] HTTP exception thrown: Instance 8eefd03e-9e6e-4710-b228-b87c5ddf475f could not be found. Jun 22 09:00:10.551138 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ba7eeafa-91f3-4bda-9afc-64099c898bd6 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Request method failure captured: Jun 22 09:00:10.551138 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: request: GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f HTTP/1.1 Jun 22 09:00:10.551138 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept: application/json Jun 22 09:00:10.551138 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept-Encoding: identity Jun 22 09:00:10.551138 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Connection: close Jun 22 09:00:10.551138 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Length: 0 Jun 22 09:00:10.551138 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Type: application/json Jun 22 09:00:10.551138 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Host: 10.222.0.16 Jun 22 09:00:10.551138 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Openstack-System-Scope: None Jun 22 09:00:10.551138 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: User-Agent: python-urllib3/1.26.9 Jun 22 09:00:10.551138 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Auth-Token: gAAAAABistmmV3E7NTIcJe9th2n1aSvuaXherPgKLUecSK2gxgC5ahtb8HNSWci4dDdie3MUJ6KSMib2frsVsDYWR5DqUtj4t1nQZdtzYoTAGq5KgG930cOq__7DgbVemosQyOvC2b0pyARD5Mb0JxePj6BsBDcI6mRRFp6_WGPOah59FRnmLCg Jun 22 09:00:10.551138 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Id: None Jun 22 09:00:10.551138 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Name: None Jun 22 09:00:10.551138 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Identity-Status: Confirmed Jun 22 09:00:10.551138 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Is-Admin-Project: True Jun 22 09:00:10.551138 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Id: default Jun 22 09:00:10.551138 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Name: Default Jun 22 09:00:10.551138 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Id: 2c5502a8e1c8480aa5e683c73b112064 Jun 22 09:00:10.551138 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Name: tempest-DeleteServersTestJSON-1045906520 Jun 22 09:00:10.551138 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Role: member,reader Jun 22 09:00:10.551138 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Roles: member,reader Jun 22 09:00:10.552559 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2c5502a8e1c8480aa5e683c73b112064"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2c5502a8e1c8480aa5e683c73b112064"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2c5502a8e1c8480aa5e683c73b112064"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2c5502a8e1c8480aa5e683c73b112064", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:00:10.552559 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant: tempest-DeleteServersTestJSON-1045906520 Jun 22 09:00:10.552559 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Id: 2c5502a8e1c8480aa5e683c73b112064 Jun 22 09:00:10.552559 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Name: tempest-DeleteServersTestJSON-1045906520 Jun 22 09:00:10.552559 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User: tempest-DeleteServersTestJSON-1045906520-project Jun 22 09:00:10.552559 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Id: default Jun 22 09:00:10.552559 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Name: Default Jun 22 09:00:10.552559 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Id: c0d27459025c40c5acdfd284ab338b1e Jun 22 09:00:10.552559 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Name: tempest-DeleteServersTestJSON-1045906520-project Jun 22 09:00:10.552559 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: method: > Jun 22 09:00:10.552559 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: exception: Instance 8eefd03e-9e6e-4710-b228-b87c5ddf475f could not be found. Jun 22 09:00:10.552559 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: action_args: {'id': '8eefd03e-9e6e-4710-b228-b87c5ddf475f'} Jun 22 09:00:10.553338 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:00:10.553338 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:10.553338 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:00:10.553338 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:00:10.553338 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:00:10.553338 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:00:10.553338 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:00:10.553338 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:00:10.553338 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:00:10.553338 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:00:10.553338 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8eefd03e-9e6e-4710-b228-b87c5ddf475f could not be found. Jun 22 09:00:10.553338 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:10.553338 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:10.553338 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:10.553338 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:10.553338 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:10.553338 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:10.553338 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:00:10.553338 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:00:10.553338 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:00:10.554377 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:00:10.554377 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:00:10.554377 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:00:10.554377 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:00:10.554377 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:00:10.554377 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:00:10.554377 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:00:10.554377 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8eefd03e-9e6e-4710-b228-b87c5ddf475f could not be found. Jun 22 09:00:10.554377 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:10.554377 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:10.554377 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:10.554377 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:10.554377 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:10.554377 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:10.554377 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:00:10.554377 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:00:10.554377 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8eefd03e-9e6e-4710-b228-b87c5ddf475f could not be found. Jun 22 09:00:10.554377 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:10.555372 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ba7eeafa-91f3-4bda-9afc-64099c898bd6 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] Returning 404 to user: Instance 8eefd03e-9e6e-4710-b228-b87c5ddf475f could not be found. {{(pid=118024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:00:10.555372 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ba7eeafa-91f3-4bda-9afc-64099c898bd6 tempest-DeleteServersTestJSON-1045906520 tempest-DeleteServersTestJSON-1045906520-project] 10.222.0.16 "GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f" status: 404 len: 111 microversion: 2.1 time: 0.029626 Jun 22 09:00:10.555372 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 198/421] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:10 2022] GET /compute/v2.1/servers/8eefd03e-9e6e-4710-b228-b87c5ddf475f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 09:00:10.576446 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-986e3724-5daf-458e-9948-3c9036c92d87 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 204 len: 0 microversion: 2.1 time: 0.295616 Jun 22 09:00:10.577018 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 224/422] 10.222.0.16 () {58 vars in 1238 bytes} [Wed Jun 22 09:00:10 2022] DELETE /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 09:00:10.585822 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-aa84df72-e646-402c-a282-19579f06cb00 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:10.586674 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-aa84df72-e646-402c-a282-19579f06cb00 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:10.592912 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-aa84df72-e646-402c-a282-19579f06cb00 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:10.593364 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-aa84df72-e646-402c-a282-19579f06cb00 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:10.594128 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-aa84df72-e646-402c-a282-19579f06cb00 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:10.594566 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-aa84df72-e646-402c-a282-19579f06cb00 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:11.043081 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d6574001-33d2-4a67-b851-4ec24a766548 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:11.043830 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-d6574001-33d2-4a67-b851-4ec24a766548 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:11.050936 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d6574001-33d2-4a67-b851-4ec24a766548 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:11.051411 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d6574001-33d2-4a67-b851-4ec24a766548 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:11.052187 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d6574001-33d2-4a67-b851-4ec24a766548 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:11.052627 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d6574001-33d2-4a67-b851-4ec24a766548 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:11.080360 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-aa84df72-e646-402c-a282-19579f06cb00 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:11.089953 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-aa84df72-e646-402c-a282-19579f06cb00 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1503 microversion: 2.1 time: 0.508044 Jun 22 09:00:11.090484 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 199/423] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:10 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1503 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:11.283091 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-e1c35836-64a4-47f6-a605-44a62a7fda98 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:11.283736 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-e1c35836-64a4-47f6-a605-44a62a7fda98 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:11.290455 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e1c35836-64a4-47f6-a605-44a62a7fda98 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:11.290901 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e1c35836-64a4-47f6-a605-44a62a7fda98 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:11.291723 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e1c35836-64a4-47f6-a605-44a62a7fda98 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:11.292154 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e1c35836-64a4-47f6-a605-44a62a7fda98 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:11.342302 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-d6574001-33d2-4a67-b851-4ec24a766548 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:11.350195 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d6574001-33d2-4a67-b851-4ec24a766548 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.312770 Jun 22 09:00:11.350771 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 225/424] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:11 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:11.588897 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-e1c35836-64a4-47f6-a605-44a62a7fda98 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:11.596745 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-e1c35836-64a4-47f6-a605-44a62a7fda98 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1507 microversion: 2.1 time: 0.319407 Jun 22 09:00:11.597330 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 200/425] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:11 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1507 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:12.111335 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-cb922cc0-789e-45e0-baf9-40ae136737b5 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:12.112463 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-cb922cc0-789e-45e0-baf9-40ae136737b5 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:12.118942 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cb922cc0-789e-45e0-baf9-40ae136737b5 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:12.119390 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cb922cc0-789e-45e0-baf9-40ae136737b5 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:12.120154 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cb922cc0-789e-45e0-baf9-40ae136737b5 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:12.120586 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cb922cc0-789e-45e0-baf9-40ae136737b5 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:12.367797 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-754a1b7c-49a8-4f7c-ac44-f7a410da0795 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:12.369071 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-754a1b7c-49a8-4f7c-ac44-f7a410da0795 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:12.376036 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-754a1b7c-49a8-4f7c-ac44-f7a410da0795 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:12.376491 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-754a1b7c-49a8-4f7c-ac44-f7a410da0795 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:12.377332 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-754a1b7c-49a8-4f7c-ac44-f7a410da0795 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:12.377747 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-754a1b7c-49a8-4f7c-ac44-f7a410da0795 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:12.409901 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-cb922cc0-789e-45e0-baf9-40ae136737b5 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:12.426498 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-cb922cc0-789e-45e0-baf9-40ae136737b5 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1503 microversion: 2.1 time: 0.322613 Jun 22 09:00:12.436004 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 226/426] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:12 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1503 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:12.655005 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-754a1b7c-49a8-4f7c-ac44-f7a410da0795 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:12.664255 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-754a1b7c-49a8-4f7c-ac44-f7a410da0795 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.300296 Jun 22 09:00:12.665110 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 201/427] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:12 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:13.446378 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-deb9deeb-cefa-4b7a-9255-8b1e486d3ca0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:13.447518 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-deb9deeb-cefa-4b7a-9255-8b1e486d3ca0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:13.453903 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-deb9deeb-cefa-4b7a-9255-8b1e486d3ca0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:13.455495 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-deb9deeb-cefa-4b7a-9255-8b1e486d3ca0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:13.456467 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-deb9deeb-cefa-4b7a-9255-8b1e486d3ca0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:13.456947 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-deb9deeb-cefa-4b7a-9255-8b1e486d3ca0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:13.596195 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-deb9deeb-cefa-4b7a-9255-8b1e486d3ca0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:13.603972 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-deb9deeb-cefa-4b7a-9255-8b1e486d3ca0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1503 microversion: 2.1 time: 0.161614 Jun 22 09:00:13.604618 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 227/428] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:13 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:13.683135 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-d2735bd5-0a52-4e57-af3d-0d6171358ff0 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:13.683754 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-d2735bd5-0a52-4e57-af3d-0d6171358ff0 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:13.687559 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:13.691581 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d2735bd5-0a52-4e57-af3d-0d6171358ff0 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:13.691970 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d2735bd5-0a52-4e57-af3d-0d6171358ff0 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:13.693007 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d2735bd5-0a52-4e57-af3d-0d6171358ff0 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:13.693645 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d2735bd5-0a52-4e57-af3d-0d6171358ff0 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:14.234161 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-d2735bd5-0a52-4e57-af3d-0d6171358ff0 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:14.245057 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-d2735bd5-0a52-4e57-af3d-0d6171358ff0 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.566312 Jun 22 09:00:14.246108 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 202/429] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:13 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:14.623413 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-32f1bc80-c3b9-45c7-b7fb-eb27ad6d5a08 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:14.624032 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-32f1bc80-c3b9-45c7-b7fb-eb27ad6d5a08 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:14.635873 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-32f1bc80-c3b9-45c7-b7fb-eb27ad6d5a08 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:14.642536 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-32f1bc80-c3b9-45c7-b7fb-eb27ad6d5a08 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:14.643557 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-32f1bc80-c3b9-45c7-b7fb-eb27ad6d5a08 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:14.644133 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-32f1bc80-c3b9-45c7-b7fb-eb27ad6d5a08 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:14.723462 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [req-73693572-b408-41ea-af68-60c57d909cf9 req-478422d6-77b3-4b38-8d59-76539542fe11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcee9695-f963-4f49-a7c9-5ec8625273cf", "name": "network-vif-deleted", "tag": "7ba885ec-f8db-4e7a-8345-1e4ec200323b"}]} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:14.733689 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-73693572-b408-41ea-af68-60c57d909cf9 req-478422d6-77b3-4b38-8d59-76539542fe11 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:14.734133 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-73693572-b408-41ea-af68-60c57d909cf9 req-478422d6-77b3-4b38-8d59-76539542fe11 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:14.747014 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.compute.server_external_events [req-73693572-b408-41ea-af68-60c57d909cf9 req-478422d6-77b3-4b38-8d59-76539542fe11 service nova] Creating event network-vif-deleted:7ba885ec-f8db-4e7a-8345-1e4ec200323b for instance fcee9695-f963-4f49-a7c9-5ec8625273cf on hv-cinder-84599 Jun 22 09:00:14.752567 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [req-73693572-b408-41ea-af68-60c57d909cf9 req-478422d6-77b3-4b38-8d59-76539542fe11 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033247 Jun 22 09:00:14.753223 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 203/430] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:14.790520 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-32f1bc80-c3b9-45c7-b7fb-eb27ad6d5a08 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:14.809692 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-32f1bc80-c3b9-45c7-b7fb-eb27ad6d5a08 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1461 microversion: 2.1 time: 0.191871 Jun 22 09:00:14.811730 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 228/431] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:14 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1461 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:15.263205 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ce43d4f7-4709-4387-9826-e08be18f696f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:15.267585 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ce43d4f7-4709-4387-9826-e08be18f696f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:15.271396 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ce43d4f7-4709-4387-9826-e08be18f696f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:15.271968 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ce43d4f7-4709-4387-9826-e08be18f696f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:15.272615 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ce43d4f7-4709-4387-9826-e08be18f696f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:15.273092 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ce43d4f7-4709-4387-9826-e08be18f696f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:15.512447 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ce43d4f7-4709-4387-9826-e08be18f696f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:15.520273 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ce43d4f7-4709-4387-9826-e08be18f696f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.261256 Jun 22 09:00:15.520866 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 204/432] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:15 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:15.829662 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7d38ce72-1a71-49c7-8db4-5a6f4a4ecbb8 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:15.830359 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7d38ce72-1a71-49c7-8db4-5a6f4a4ecbb8 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:15.839439 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7d38ce72-1a71-49c7-8db4-5a6f4a4ecbb8 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:15.839886 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7d38ce72-1a71-49c7-8db4-5a6f4a4ecbb8 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:15.840664 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7d38ce72-1a71-49c7-8db4-5a6f4a4ecbb8 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:15.841155 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7d38ce72-1a71-49c7-8db4-5a6f4a4ecbb8 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:15.874979 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7d38ce72-1a71-49c7-8db4-5a6f4a4ecbb8 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:15.875427 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7d38ce72-1a71-49c7-8db4-5a6f4a4ecbb8 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:15.876595 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.objects.instance [None req-7d38ce72-1a71-49c7-8db4-5a6f4a4ecbb8 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lazy-loading 'fault' on Instance uuid fcee9695-f963-4f49-a7c9-5ec8625273cf {{(pid=118025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:00:15.926646 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7d38ce72-1a71-49c7-8db4-5a6f4a4ecbb8 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:15.934475 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7d38ce72-1a71-49c7-8db4-5a6f4a4ecbb8 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 200 len: 1304 microversion: 2.1 time: 0.109368 Jun 22 09:00:15.944319 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 229/433] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:15 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:16.537773 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ef008e65-e6a1-4a75-87ca-fb9b2f976ea4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:16.538386 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ef008e65-e6a1-4a75-87ca-fb9b2f976ea4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:16.544840 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ef008e65-e6a1-4a75-87ca-fb9b2f976ea4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:16.545612 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ef008e65-e6a1-4a75-87ca-fb9b2f976ea4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:16.546042 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ef008e65-e6a1-4a75-87ca-fb9b2f976ea4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:16.546483 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ef008e65-e6a1-4a75-87ca-fb9b2f976ea4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:16.701623 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ef008e65-e6a1-4a75-87ca-fb9b2f976ea4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:16.717287 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ef008e65-e6a1-4a75-87ca-fb9b2f976ea4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.183160 Jun 22 09:00:16.717875 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 205/434] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:16 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:16.951469 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-33db6945-9826-425a-8ed3-2b928d2b41e8 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:16.952226 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-33db6945-9826-425a-8ed3-2b928d2b41e8 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: fcee9695-f963-4f49-a7c9-5ec8625273cf] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:16.958568 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-33db6945-9826-425a-8ed3-2b928d2b41e8 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:16.959022 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-33db6945-9826-425a-8ed3-2b928d2b41e8 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:16.959790 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-33db6945-9826-425a-8ed3-2b928d2b41e8 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:16.960227 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-33db6945-9826-425a-8ed3-2b928d2b41e8 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:16.976798 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.wsgi [None req-33db6945-9826-425a-8ed3-2b928d2b41e8 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] HTTP exception thrown: Instance fcee9695-f963-4f49-a7c9-5ec8625273cf could not be found. Jun 22 09:00:16.978396 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-33db6945-9826-425a-8ed3-2b928d2b41e8 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Request method failure captured: Jun 22 09:00:16.978396 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: request: GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf HTTP/1.1 Jun 22 09:00:16.978396 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept: application/json Jun 22 09:00:16.978396 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept-Encoding: identity Jun 22 09:00:16.978396 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Connection: close Jun 22 09:00:16.978396 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Length: 0 Jun 22 09:00:16.978396 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Type: application/json Jun 22 09:00:16.978396 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Host: 10.222.0.16 Jun 22 09:00:16.978396 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Openstack-System-Scope: None Jun 22 09:00:16.978396 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: User-Agent: python-urllib3/1.26.9 Jun 22 09:00:16.978396 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Auth-Token: gAAAAABistnhcoABsd0qqvKCvnNhVgCkxtxqGkbkhXwBAi8HdddLEfhllFC85DUFp6QAc9Bk9ESJr46qW_EMSv0YtYBUnPyjxIG6e-qtUqcIp_3vato3x8dxgr4Fhdmy0atVPb2hQ6DbGq0SP1epgCXHGqHrYWyvx4K4yrPndbmXi2MPu0iToKk Jun 22 09:00:16.978396 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Id: None Jun 22 09:00:16.978396 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Name: None Jun 22 09:00:16.978396 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Identity-Status: Confirmed Jun 22 09:00:16.978396 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Is-Admin-Project: True Jun 22 09:00:16.978396 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Id: default Jun 22 09:00:16.978396 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Name: Default Jun 22 09:00:16.978396 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Id: 057f604657a84a1ab5690adec51c01c1 Jun 22 09:00:16.978396 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Name: tempest-VolumesActionsTest-597472862 Jun 22 09:00:16.978396 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Role: member,reader Jun 22 09:00:16.978396 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Roles: member,reader Jun 22 09:00:16.979999 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/057f604657a84a1ab5690adec51c01c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/057f604657a84a1ab5690adec51c01c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/057f604657a84a1ab5690adec51c01c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_057f604657a84a1ab5690adec51c01c1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:00:16.979999 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant: tempest-VolumesActionsTest-597472862 Jun 22 09:00:16.979999 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Id: 057f604657a84a1ab5690adec51c01c1 Jun 22 09:00:16.979999 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Name: tempest-VolumesActionsTest-597472862 Jun 22 09:00:16.979999 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User: tempest-VolumesActionsTest-597472862-project Jun 22 09:00:16.979999 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Id: default Jun 22 09:00:16.979999 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Name: Default Jun 22 09:00:16.979999 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Id: 3692a330bd744eb29008156ad6a546ce Jun 22 09:00:16.979999 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Name: tempest-VolumesActionsTest-597472862-project Jun 22 09:00:16.979999 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: method: > Jun 22 09:00:16.979999 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: exception: Instance fcee9695-f963-4f49-a7c9-5ec8625273cf could not be found. Jun 22 09:00:16.979999 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: action_args: {'id': 'fcee9695-f963-4f49-a7c9-5ec8625273cf'} Jun 22 09:00:16.980772 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:00:16.980772 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:16.980772 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:00:16.980772 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:00:16.980772 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:00:16.980772 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:00:16.980772 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:00:16.980772 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:00:16.980772 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:00:16.980772 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:00:16.980772 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcee9695-f963-4f49-a7c9-5ec8625273cf could not be found. Jun 22 09:00:16.980772 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:00:16.980772 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:16.980772 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:00:16.980772 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:16.980772 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:16.980772 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:16.980772 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:00:16.980772 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:00:16.980772 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:00:16.981875 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:00:16.981875 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:00:16.981875 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:00:16.981875 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:00:16.981875 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:00:16.981875 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:00:16.981875 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:00:16.981875 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcee9695-f963-4f49-a7c9-5ec8625273cf could not be found. Jun 22 09:00:16.981875 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:00:16.981875 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:16.981875 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:00:16.981875 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:16.981875 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:16.981875 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:16.981875 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:00:16.981875 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:00:16.981875 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcee9695-f963-4f49-a7c9-5ec8625273cf could not be found. Jun 22 09:00:16.981875 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:00:16.982970 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-33db6945-9826-425a-8ed3-2b928d2b41e8 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Returning 404 to user: Instance fcee9695-f963-4f49-a7c9-5ec8625273cf could not be found. {{(pid=118025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:00:16.982970 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-33db6945-9826-425a-8ed3-2b928d2b41e8 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf" status: 404 len: 111 microversion: 2.1 time: 0.032439 Jun 22 09:00:16.982970 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 230/435] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:16 2022] GET /compute/v2.1/servers/fcee9695-f963-4f49-a7c9-5ec8625273cf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 09:00:17.090606 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a2fe6797-975b-4b88-8d66-63871058c6a0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-734571198", "imageRef": "c24d36a8-7909-4174-9b12-42c8d76647ac", "flavorRef": "452", "networks": [{"uuid": "811c3731-2235-4a58-bcd9-ec44095cd913"}]}} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:17.356846 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e7b9d45f-bf1d-4045-99e0-bb050dc33d1f tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] Action: 'create', calling method: .version_select at 0x7f57564d3d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2095498323"}} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:17.952530 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e7b9d45f-bf1d-4045-99e0-bb050dc33d1f tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.715974 Jun 22 09:00:17.953174 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 231/436] 10.222.0.16 () {60 vars in 1154 bytes} [Wed Jun 22 09:00:17 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 717 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 22 09:00:17.958258 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-faff4362-ee40-46cc-89c6-62be00c3ead6 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:17.959010 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-faff4362-ee40-46cc-89c6-62be00c3ead6 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:17.966418 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-faff4362-ee40-46cc-89c6-62be00c3ead6 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:17.966922 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-faff4362-ee40-46cc-89c6-62be00c3ead6 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:17.967691 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-faff4362-ee40-46cc-89c6-62be00c3ead6 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:17.968161 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-faff4362-ee40-46cc-89c6-62be00c3ead6 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:18.100376 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-faff4362-ee40-46cc-89c6-62be00c3ead6 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:18.107872 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-faff4362-ee40-46cc-89c6-62be00c3ead6 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.153689 Jun 22 09:00:18.108424 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 232/437] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:17 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:18.113224 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-401abb3c-120d-4604-a637-d6bee0c8a70b tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] Calling method '.version_select at 0x7f57564d3a60>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:18.161365 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-401abb3c-120d-4604-a637-d6bee0c8a70b tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/86e09d16-c3ef-4eb8-9f4f-e4e1f5753130" status: 200 len: 345 microversion: 2.1 time: 0.051812 Jun 22 09:00:18.161990 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 233/438] 10.222.0.16 () {58 vars in 1244 bytes} [Wed Jun 22 09:00:18 2022] GET /compute/v2.1/os-volumes/86e09d16-c3ef-4eb8-9f4f-e4e1f5753130 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:19.125012 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-b683bb06-7993-4ae1-9e69-46dd4c81dca2 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:19.125641 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-b683bb06-7993-4ae1-9e69-46dd4c81dca2 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:19.131883 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b683bb06-7993-4ae1-9e69-46dd4c81dca2 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:19.132329 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b683bb06-7993-4ae1-9e69-46dd4c81dca2 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:19.133179 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b683bb06-7993-4ae1-9e69-46dd4c81dca2 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:19.133625 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b683bb06-7993-4ae1-9e69-46dd4c81dca2 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:19.264870 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-b683bb06-7993-4ae1-9e69-46dd4c81dca2 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:19.272843 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-b683bb06-7993-4ae1-9e69-46dd4c81dca2 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.151703 Jun 22 09:00:19.273392 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 234/439] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:19 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:19.277661 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c21ace4a-ab9b-43fd-8783-9e90f90be183 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] Calling method '.version_select at 0x7f57564d35e0>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:19.323213 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c21ace4a-ab9b-43fd-8783-9e90f90be183 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/86e09d16-c3ef-4eb8-9f4f-e4e1f5753130" status: 200 len: 345 microversion: 2.1 time: 0.048792 Jun 22 09:00:19.323802 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 235/440] 10.222.0.16 () {58 vars in 1244 bytes} [Wed Jun 22 09:00:19 2022] GET /compute/v2.1/os-volumes/86e09d16-c3ef-4eb8-9f4f-e4e1f5753130 => generated 345 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:20.290511 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-0996c18b-99f1-4336-a049-64c6913a7ce9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:20.291128 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-0996c18b-99f1-4336-a049-64c6913a7ce9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:20.297207 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0996c18b-99f1-4336-a049-64c6913a7ce9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:20.297731 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0996c18b-99f1-4336-a049-64c6913a7ce9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:20.298487 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0996c18b-99f1-4336-a049-64c6913a7ce9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:20.298924 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0996c18b-99f1-4336-a049-64c6913a7ce9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:20.427892 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-0996c18b-99f1-4336-a049-64c6913a7ce9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:20.435937 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-0996c18b-99f1-4336-a049-64c6913a7ce9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.150168 Jun 22 09:00:20.436502 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 236/441] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:20 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:20.440799 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d3da71b9-a372-42cb-ae6f-5aa7e65905ce tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] Calling method '.version_select at 0x7f57564d31f0>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:20.490910 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d3da71b9-a372-42cb-ae6f-5aa7e65905ce tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/86e09d16-c3ef-4eb8-9f4f-e4e1f5753130" status: 200 len: 346 microversion: 2.1 time: 0.053321 Jun 22 09:00:20.491473 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 237/442] 10.222.0.16 () {58 vars in 1244 bytes} [Wed Jun 22 09:00:20 2022] GET /compute/v2.1/os-volumes/86e09d16-c3ef-4eb8-9f4f-e4e1f5753130 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:20.501927 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-759987bd-74a1-4217-8d87-a339afc0f855 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] Action: 'create', calling method: .version_select at 0x7f57564c44c0>, body: {"snapshot": {"volume_id": "86e09d16-c3ef-4eb8-9f4f-e4e1f5753130", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-384757382"}} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:20.902599 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-759987bd-74a1-4217-8d87-a339afc0f855 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.404085 Jun 22 09:00:20.903279 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 238/443] 10.222.0.16 () {60 vars in 1161 bytes} [Wed Jun 22 09:00:20 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:00:20.914025 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f316b8c7-1691-4b46-9688-4e94f3ee5e22 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] Calling method '.version_select at 0x7f57563c1ca0>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:20.945577 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f316b8c7-1691-4b46-9688-4e94f3ee5e22 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/db01ca61-7642-4f3c-965f-67832174349a" status: 200 len: 286 microversion: 2.1 time: 0.035686 Jun 22 09:00:20.946152 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 239/444] 10.222.0.16 () {58 vars in 1250 bytes} [Wed Jun 22 09:00:20 2022] GET /compute/v2.1/os-snapshots/db01ca61-7642-4f3c-965f-67832174349a => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:00:20.955557 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a508d312-3bac-4f3b-9929-0d70d537812d tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] Calling method '.version_select at 0x7f5756466310>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:20.998167 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a508d312-3bac-4f3b-9929-0d70d537812d tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.046017 Jun 22 09:00:20.998744 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 240/445] 10.222.0.16 () {58 vars in 1139 bytes} [Wed Jun 22 09:00:20 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:00:21.010391 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a6605965-1bc5-4abf-a8b1-03b979f751ed tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] Calling method '.version_select at 0x7f57564d34c0>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:21.042870 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a6605965-1bc5-4abf-a8b1-03b979f751ed tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/db01ca61-7642-4f3c-965f-67832174349a" status: 200 len: 286 microversion: 2.1 time: 0.034582 Jun 22 09:00:21.042870 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 241/446] 10.222.0.16 () {58 vars in 1250 bytes} [Wed Jun 22 09:00:21 2022] GET /compute/v2.1/os-snapshots/db01ca61-7642-4f3c-965f-67832174349a => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:00:21.453052 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-0d2d1c2c-ab61-480a-8943-f59af6e50d77 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:21.453730 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-0d2d1c2c-ab61-480a-8943-f59af6e50d77 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:21.460178 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0d2d1c2c-ab61-480a-8943-f59af6e50d77 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:21.460625 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0d2d1c2c-ab61-480a-8943-f59af6e50d77 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:21.461409 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0d2d1c2c-ab61-480a-8943-f59af6e50d77 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:21.461846 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0d2d1c2c-ab61-480a-8943-f59af6e50d77 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:21.589484 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-0d2d1c2c-ab61-480a-8943-f59af6e50d77 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:21.598599 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-0d2d1c2c-ab61-480a-8943-f59af6e50d77 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.149374 Jun 22 09:00:21.599178 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 242/447] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:21 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:22.052915 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-fee05498-c76a-4ce9-bf64-03c338da868b tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] Calling method '.version_select at 0x7f57563c1f70>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:22.086501 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-fee05498-c76a-4ce9-bf64-03c338da868b tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/db01ca61-7642-4f3c-965f-67832174349a" status: 200 len: 286 microversion: 2.1 time: 0.037879 Jun 22 09:00:22.087190 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 243/448] 10.222.0.16 () {58 vars in 1250 bytes} [Wed Jun 22 09:00:22 2022] GET /compute/v2.1/os-snapshots/db01ca61-7642-4f3c-965f-67832174349a => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:00:22.511861 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.network.neutron [None req-a2fe6797-975b-4b88-8d66-63871058c6a0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] validate_networks() for [('811c3731-2235-4a58-bcd9-ec44095cd913', None, None, None, None, None)] {{(pid=118024) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:00:22.619176 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-991cd6d3-5ecc-4a0e-9a3a-decfd5ab725a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:22.620125 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-991cd6d3-5ecc-4a0e-9a3a-decfd5ab725a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:22.627318 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-991cd6d3-5ecc-4a0e-9a3a-decfd5ab725a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:22.627986 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-991cd6d3-5ecc-4a0e-9a3a-decfd5ab725a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:22.628903 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-991cd6d3-5ecc-4a0e-9a3a-decfd5ab725a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:22.629792 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-991cd6d3-5ecc-4a0e-9a3a-decfd5ab725a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:22.873578 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-991cd6d3-5ecc-4a0e-9a3a-decfd5ab725a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:22.881414 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-991cd6d3-5ecc-4a0e-9a3a-decfd5ab725a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.267576 Jun 22 09:00:22.882663 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 244/449] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:22 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:22.965735 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-a2fe6797-975b-4b88-8d66-63871058c6a0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Flavor limits 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:00:22.966157 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-a2fe6797-975b-4b88-8d66-63871058c6a0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Image limits 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:00:22.966623 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-a2fe6797-975b-4b88-8d66-63871058c6a0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Flavor pref 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:00:22.967107 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-a2fe6797-975b-4b88-8d66-63871058c6a0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Image pref 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:00:22.967504 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-a2fe6797-975b-4b88-8d66-63871058c6a0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:00:22.977366 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a2fe6797-975b-4b88-8d66-63871058c6a0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:22.977811 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a2fe6797-975b-4b88-8d66-63871058c6a0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:22.978911 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a2fe6797-975b-4b88-8d66-63871058c6a0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:22.979342 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a2fe6797-975b-4b88-8d66-63871058c6a0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:22.996521 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.quota [None req-a2fe6797-975b-4b88-8d66-63871058c6a0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Getting quotas for project 057f604657a84a1ab5690adec51c01c1. Resources: {'cores', 'instances', 'ram'} {{(pid=118024) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:00:23.000441 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.quota [None req-a2fe6797-975b-4b88-8d66-63871058c6a0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Getting quotas for user 3692a330bd744eb29008156ad6a546ce and project 057f604657a84a1ab5690adec51c01c1. Resources: {'cores', 'instances', 'ram'} {{(pid=118024) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:00:23.012024 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a2fe6797-975b-4b88-8d66-63871058c6a0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Going to run 1 instances... {{(pid=118024) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:00:23.014302 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a2fe6797-975b-4b88-8d66-63871058c6a0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c24d36a8-7909-4174-9b12-42c8d76647ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118024) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:00:23.100465 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-4a7fe761-cb48-428d-b9a8-7da711129098 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] Calling method '.version_select at 0x7f57563c1ee0>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:23.129468 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a2fe6797-975b-4b88-8d66-63871058c6a0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.041678 Jun 22 09:00:23.130219 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-4a7fe761-cb48-428d-b9a8-7da711129098 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/db01ca61-7642-4f3c-965f-67832174349a" status: 200 len: 286 microversion: 2.1 time: 0.036174 Jun 22 09:00:23.130739 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 206/450] 10.222.0.16 () {60 vars in 1146 bytes} [Wed Jun 22 09:00:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 6045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:00:23.131291 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 245/451] 10.222.0.16 () {58 vars in 1250 bytes} [Wed Jun 22 09:00:23 2022] GET /compute/v2.1/os-snapshots/db01ca61-7642-4f3c-965f-67832174349a => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:23.144293 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-5d86ba5b-8c36-4320-84cd-45c1665b14f1 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:23.144933 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-5d86ba5b-8c36-4320-84cd-45c1665b14f1 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:23.201341 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-5d86ba5b-8c36-4320-84cd-45c1665b14f1 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:23.211574 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-5d86ba5b-8c36-4320-84cd-45c1665b14f1 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 200 len: 1213 microversion: 2.1 time: 0.071472 Jun 22 09:00:23.212445 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 207/452] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:23 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:23.898682 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-0e6765a1-527e-40ff-a4c6-aec216d3f795 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:23.899286 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-0e6765a1-527e-40ff-a4c6-aec216d3f795 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:23.905268 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0e6765a1-527e-40ff-a4c6-aec216d3f795 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:23.909039 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0e6765a1-527e-40ff-a4c6-aec216d3f795 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:23.909039 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0e6765a1-527e-40ff-a4c6-aec216d3f795 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:23.909039 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0e6765a1-527e-40ff-a4c6-aec216d3f795 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:24.043936 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-0e6765a1-527e-40ff-a4c6-aec216d3f795 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:24.051701 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-0e6765a1-527e-40ff-a4c6-aec216d3f795 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.156969 Jun 22 09:00:24.052249 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 246/453] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:23 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:24.142555 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c61eb381-275f-4c35-956b-19c15a8c35bb tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] Calling method '.version_select at 0x7f5756db3ee0>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:24.172614 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c61eb381-275f-4c35-956b-19c15a8c35bb tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/db01ca61-7642-4f3c-965f-67832174349a" status: 200 len: 286 microversion: 2.1 time: 0.034510 Jun 22 09:00:24.173278 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 208/454] 10.222.0.16 () {58 vars in 1250 bytes} [Wed Jun 22 09:00:24 2022] GET /compute/v2.1/os-snapshots/db01ca61-7642-4f3c-965f-67832174349a => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:24.230294 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7e8daa09-d82b-4da7-bd97-81acbdbea11e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:24.230906 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7e8daa09-d82b-4da7-bd97-81acbdbea11e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:24.237239 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7e8daa09-d82b-4da7-bd97-81acbdbea11e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:24.237712 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7e8daa09-d82b-4da7-bd97-81acbdbea11e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:24.238499 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7e8daa09-d82b-4da7-bd97-81acbdbea11e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:24.238938 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7e8daa09-d82b-4da7-bd97-81acbdbea11e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:24.297583 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7e8daa09-d82b-4da7-bd97-81acbdbea11e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:24.304855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7e8daa09-d82b-4da7-bd97-81acbdbea11e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 200 len: 1217 microversion: 2.1 time: 0.078799 Jun 22 09:00:24.305427 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 247/455] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:24 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:25.068802 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-02201280-e5c6-414e-8b7f-d968b57cf4fe tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:25.069419 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-02201280-e5c6-414e-8b7f-d968b57cf4fe tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:25.075636 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-02201280-e5c6-414e-8b7f-d968b57cf4fe tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:25.076099 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-02201280-e5c6-414e-8b7f-d968b57cf4fe tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:25.076909 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-02201280-e5c6-414e-8b7f-d968b57cf4fe tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:25.077351 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-02201280-e5c6-414e-8b7f-d968b57cf4fe tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:25.185145 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c89750bb-8f6a-48f2-8e9a-8037e52e9c91 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] Calling method '.version_select at 0x7f57564d2550>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:25.216048 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-02201280-e5c6-414e-8b7f-d968b57cf4fe tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:25.222622 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c89750bb-8f6a-48f2-8e9a-8037e52e9c91 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/db01ca61-7642-4f3c-965f-67832174349a" status: 200 len: 286 microversion: 2.1 time: 0.041586 Jun 22 09:00:25.225488 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-02201280-e5c6-414e-8b7f-d968b57cf4fe tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.160602 Jun 22 09:00:25.226141 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 209/456] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:25 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:25.226800 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 248/457] 10.222.0.16 () {58 vars in 1250 bytes} [Wed Jun 22 09:00:25 2022] GET /compute/v2.1/os-snapshots/db01ca61-7642-4f3c-965f-67832174349a => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:00:25.322440 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-770feada-f492-4105-9432-8bd569ef1df5 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:25.323051 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-770feada-f492-4105-9432-8bd569ef1df5 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:25.330309 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-770feada-f492-4105-9432-8bd569ef1df5 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:25.330773 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-770feada-f492-4105-9432-8bd569ef1df5 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:25.331540 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-770feada-f492-4105-9432-8bd569ef1df5 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:25.332008 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-770feada-f492-4105-9432-8bd569ef1df5 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:25.391014 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-770feada-f492-4105-9432-8bd569ef1df5 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:25.394418 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:25.400183 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-770feada-f492-4105-9432-8bd569ef1df5 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 200 len: 1217 microversion: 2.1 time: 0.081662 Jun 22 09:00:25.400747 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 210/458] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:25 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:26.234277 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2aca32d5-bd62-4434-9e28-e9496219fb3e tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] Calling method '.version_select at 0x7f57563c1b80>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:26.243006 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-2a431f0e-a14d-4eeb-b387-f952e7d1b91b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:26.243596 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-2a431f0e-a14d-4eeb-b387-f952e7d1b91b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:26.250610 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2a431f0e-a14d-4eeb-b387-f952e7d1b91b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:26.251632 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2a431f0e-a14d-4eeb-b387-f952e7d1b91b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:26.252408 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2a431f0e-a14d-4eeb-b387-f952e7d1b91b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:26.252879 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2a431f0e-a14d-4eeb-b387-f952e7d1b91b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:26.266753 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2aca32d5-bd62-4434-9e28-e9496219fb3e tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/db01ca61-7642-4f3c-965f-67832174349a" status: 200 len: 286 microversion: 2.1 time: 0.036342 Jun 22 09:00:26.267324 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 249/459] 10.222.0.16 () {58 vars in 1250 bytes} [Wed Jun 22 09:00:26 2022] GET /compute/v2.1/os-snapshots/db01ca61-7642-4f3c-965f-67832174349a => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:00:26.391316 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-2a431f0e-a14d-4eeb-b387-f952e7d1b91b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:26.398929 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-2a431f0e-a14d-4eeb-b387-f952e7d1b91b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.160305 Jun 22 09:00:26.399486 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 211/460] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:26 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:26.418029 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2fd1fcf8-a592-4bb2-84da-eef4b01cd252 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:26.418639 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2fd1fcf8-a592-4bb2-84da-eef4b01cd252 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:26.426333 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2fd1fcf8-a592-4bb2-84da-eef4b01cd252 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:26.426776 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2fd1fcf8-a592-4bb2-84da-eef4b01cd252 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:26.427526 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2fd1fcf8-a592-4bb2-84da-eef4b01cd252 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:26.427959 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2fd1fcf8-a592-4bb2-84da-eef4b01cd252 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:26.489120 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-2fd1fcf8-a592-4bb2-84da-eef4b01cd252 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:26.496475 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2fd1fcf8-a592-4bb2-84da-eef4b01cd252 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 200 len: 1217 microversion: 2.1 time: 0.082312 Jun 22 09:00:26.497066 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 250/461] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:26 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:27.278406 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b805edcf-7e65-4f6e-bb37-1d0bfd60df87 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] Calling method '.version_select at 0x7f5756b4ff70>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:27.309136 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-b805edcf-7e65-4f6e-bb37-1d0bfd60df87 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/db01ca61-7642-4f3c-965f-67832174349a" status: 200 len: 286 microversion: 2.1 time: 0.034431 Jun 22 09:00:27.309706 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 212/462] 10.222.0.16 () {58 vars in 1250 bytes} [Wed Jun 22 09:00:27 2022] GET /compute/v2.1/os-snapshots/db01ca61-7642-4f3c-965f-67832174349a => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:27.416275 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-66e8bfb6-d202-4549-907a-6e26d606d929 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:27.416914 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-66e8bfb6-d202-4549-907a-6e26d606d929 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:27.423014 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-66e8bfb6-d202-4549-907a-6e26d606d929 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:27.423452 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-66e8bfb6-d202-4549-907a-6e26d606d929 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:27.424322 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-66e8bfb6-d202-4549-907a-6e26d606d929 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:27.424755 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-66e8bfb6-d202-4549-907a-6e26d606d929 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:27.443844 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:27.512985 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-fc1342de-0032-4bf6-8613-f2153fa2740c tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:27.513599 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-fc1342de-0032-4bf6-8613-f2153fa2740c tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:27.519942 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fc1342de-0032-4bf6-8613-f2153fa2740c tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:27.521111 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fc1342de-0032-4bf6-8613-f2153fa2740c tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:27.521901 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fc1342de-0032-4bf6-8613-f2153fa2740c tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:27.522342 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fc1342de-0032-4bf6-8613-f2153fa2740c tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:27.553548 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-66e8bfb6-d202-4549-907a-6e26d606d929 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:27.561580 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-66e8bfb6-d202-4549-907a-6e26d606d929 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.149145 Jun 22 09:00:27.562147 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 251/463] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:27 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:27.583234 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-fc1342de-0032-4bf6-8613-f2153fa2740c tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:27.590743 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-fc1342de-0032-4bf6-8613-f2153fa2740c tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 200 len: 1217 microversion: 2.1 time: 0.081714 Jun 22 09:00:27.591292 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 213/464] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:27 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:28.321125 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-07dc1a6d-7424-4072-a7f6-5bdd0c5ed814 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] Calling method '.version_select at 0x7f57564d2430>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:28.351561 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-07dc1a6d-7424-4072-a7f6-5bdd0c5ed814 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/db01ca61-7642-4f3c-965f-67832174349a" status: 200 len: 286 microversion: 2.1 time: 0.034588 Jun 22 09:00:28.352120 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 252/465] 10.222.0.16 () {58 vars in 1250 bytes} [Wed Jun 22 09:00:28 2022] GET /compute/v2.1/os-snapshots/db01ca61-7642-4f3c-965f-67832174349a => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:00:28.579446 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b15643c8-0c8b-4c65-a383-eca67f639274 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:28.580816 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-b15643c8-0c8b-4c65-a383-eca67f639274 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:28.587325 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b15643c8-0c8b-4c65-a383-eca67f639274 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:28.587766 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b15643c8-0c8b-4c65-a383-eca67f639274 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:28.588519 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b15643c8-0c8b-4c65-a383-eca67f639274 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:28.588985 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b15643c8-0c8b-4c65-a383-eca67f639274 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:28.607633 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c8a51f65-5b0b-49e0-a958-659dae1fe495 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:28.608249 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c8a51f65-5b0b-49e0-a958-659dae1fe495 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:28.614720 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c8a51f65-5b0b-49e0-a958-659dae1fe495 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:28.615171 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c8a51f65-5b0b-49e0-a958-659dae1fe495 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:28.615939 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c8a51f65-5b0b-49e0-a958-659dae1fe495 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:28.616382 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c8a51f65-5b0b-49e0-a958-659dae1fe495 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:28.687445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c8a51f65-5b0b-49e0-a958-659dae1fe495 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:28.695540 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c8a51f65-5b0b-49e0-a958-659dae1fe495 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 200 len: 1217 microversion: 2.1 time: 0.092072 Jun 22 09:00:28.696105 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 253/466] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:28 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:28.743785 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-b15643c8-0c8b-4c65-a383-eca67f639274 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:28.751177 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-b15643c8-0c8b-4c65-a383-eca67f639274 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.175648 Jun 22 09:00:28.752232 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 214/467] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:28 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:29.363787 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-3e6815ad-0281-45ad-941e-c5414b8bfd98 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] Calling method '.version_select at 0x7f57564d23a0>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:29.394377 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-3e6815ad-0281-45ad-941e-c5414b8bfd98 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/db01ca61-7642-4f3c-965f-67832174349a" status: 200 len: 286 microversion: 2.1 time: 0.034762 Jun 22 09:00:29.394943 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 254/468] 10.222.0.16 () {58 vars in 1250 bytes} [Wed Jun 22 09:00:29 2022] GET /compute/v2.1/os-snapshots/db01ca61-7642-4f3c-965f-67832174349a => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:29.712088 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ba9f121b-d90f-4be8-b372-b791a17c8a56 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:29.712617 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ba9f121b-d90f-4be8-b372-b791a17c8a56 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:29.719148 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ba9f121b-d90f-4be8-b372-b791a17c8a56 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:29.719614 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ba9f121b-d90f-4be8-b372-b791a17c8a56 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:29.720407 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ba9f121b-d90f-4be8-b372-b791a17c8a56 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:29.720966 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ba9f121b-d90f-4be8-b372-b791a17c8a56 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:29.768911 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-363fcdb4-ba23-4b38-8418-76124aebc125 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:29.769529 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-363fcdb4-ba23-4b38-8418-76124aebc125 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:29.775558 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-363fcdb4-ba23-4b38-8418-76124aebc125 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:29.776009 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-363fcdb4-ba23-4b38-8418-76124aebc125 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:29.776793 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-363fcdb4-ba23-4b38-8418-76124aebc125 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:29.777406 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-363fcdb4-ba23-4b38-8418-76124aebc125 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:29.779571 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ba9f121b-d90f-4be8-b372-b791a17c8a56 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:29.787205 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ba9f121b-d90f-4be8-b372-b791a17c8a56 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 200 len: 1217 microversion: 2.1 time: 0.079033 Jun 22 09:00:29.787776 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 215/469] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:29 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:29.905099 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-363fcdb4-ba23-4b38-8418-76124aebc125 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:29.914561 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-363fcdb4-ba23-4b38-8418-76124aebc125 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.149692 Jun 22 09:00:29.915158 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 255/470] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:29 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:30.405165 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c08b4c33-0047-403a-94a8-6ba02d0b8177 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] Calling method '.version_select at 0x7f5756c2f550>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:30.435263 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c08b4c33-0047-403a-94a8-6ba02d0b8177 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/db01ca61-7642-4f3c-965f-67832174349a" status: 200 len: 286 microversion: 2.1 time: 0.033873 Jun 22 09:00:30.435823 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 216/471] 10.222.0.16 () {58 vars in 1250 bytes} [Wed Jun 22 09:00:30 2022] GET /compute/v2.1/os-snapshots/db01ca61-7642-4f3c-965f-67832174349a => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:30.804163 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-702788ba-6447-4516-92a4-a2d6233bf8e1 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:30.804879 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-702788ba-6447-4516-92a4-a2d6233bf8e1 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:30.811074 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-702788ba-6447-4516-92a4-a2d6233bf8e1 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:30.811514 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-702788ba-6447-4516-92a4-a2d6233bf8e1 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:30.812313 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-702788ba-6447-4516-92a4-a2d6233bf8e1 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:30.812746 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-702788ba-6447-4516-92a4-a2d6233bf8e1 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:30.873548 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-702788ba-6447-4516-92a4-a2d6233bf8e1 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:30.881781 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-702788ba-6447-4516-92a4-a2d6233bf8e1 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 200 len: 1209 microversion: 2.1 time: 0.081660 Jun 22 09:00:30.892146 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 256/472] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:30 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 1209 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:30.932492 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1a390575-fedc-4a0d-a822-97c27aee8389 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:30.933294 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1a390575-fedc-4a0d-a822-97c27aee8389 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:30.940508 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1a390575-fedc-4a0d-a822-97c27aee8389 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:30.941053 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1a390575-fedc-4a0d-a822-97c27aee8389 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:30.941814 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1a390575-fedc-4a0d-a822-97c27aee8389 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:30.942248 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1a390575-fedc-4a0d-a822-97c27aee8389 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:31.070075 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-1a390575-fedc-4a0d-a822-97c27aee8389 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:31.077807 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1a390575-fedc-4a0d-a822-97c27aee8389 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.150054 Jun 22 09:00:31.078584 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 217/473] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:30 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:31.446191 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-ed6a3822-942a-461e-9615-c048e722040a tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] Calling method '.version_select at 0x7f57563c13a0>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:31.475112 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-ed6a3822-942a-461e-9615-c048e722040a tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/db01ca61-7642-4f3c-965f-67832174349a" status: 200 len: 287 microversion: 2.1 time: 0.032610 Jun 22 09:00:31.475757 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 257/474] 10.222.0.16 () {58 vars in 1250 bytes} [Wed Jun 22 09:00:31 2022] GET /compute/v2.1/os-snapshots/db01ca61-7642-4f3c-965f-67832174349a => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:31.485732 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-155d3b93-7418-4625-ae86-562e26ce60ea tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] Calling method '.version_select at 0x7f5756b3e8b0>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:31.610719 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-155d3b93-7418-4625-ae86-562e26ce60ea tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/db01ca61-7642-4f3c-965f-67832174349a" status: 202 len: 0 microversion: 2.1 time: 0.128705 Jun 22 09:00:31.623891 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 218/475] 10.222.0.16 () {58 vars in 1253 bytes} [Wed Jun 22 09:00:31 2022] DELETE /compute/v2.1/os-snapshots/db01ca61-7642-4f3c-965f-67832174349a => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:00:31.624035 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-1755e138-f5da-4a19-adfd-4df845d6edf1 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] Calling method '.version_select at 0x7f57563c1ca0>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:31.650691 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-1755e138-f5da-4a19-adfd-4df845d6edf1 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/db01ca61-7642-4f3c-965f-67832174349a" status: 200 len: 286 microversion: 2.1 time: 0.034299 Jun 22 09:00:31.651259 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 258/476] 10.222.0.16 () {58 vars in 1250 bytes} [Wed Jun 22 09:00:31 2022] GET /compute/v2.1/os-snapshots/db01ca61-7642-4f3c-965f-67832174349a => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:31.898534 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ab039ffe-fee0-4d8e-987c-c292df951128 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:31.899310 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ab039ffe-fee0-4d8e-987c-c292df951128 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:31.905317 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ab039ffe-fee0-4d8e-987c-c292df951128 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:31.905834 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ab039ffe-fee0-4d8e-987c-c292df951128 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:31.906591 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ab039ffe-fee0-4d8e-987c-c292df951128 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:31.907025 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ab039ffe-fee0-4d8e-987c-c292df951128 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:31.969454 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ab039ffe-fee0-4d8e-987c-c292df951128 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:31.977544 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ab039ffe-fee0-4d8e-987c-c292df951128 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 200 len: 1283 microversion: 2.1 time: 0.082889 Jun 22 09:00:31.978128 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 219/477] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:31 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 1283 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:32.096390 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-adc53d4a-baa5-4796-ae5c-2ba349d93121 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:32.097641 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-adc53d4a-baa5-4796-ae5c-2ba349d93121 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:32.105041 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-adc53d4a-baa5-4796-ae5c-2ba349d93121 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:32.105578 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-adc53d4a-baa5-4796-ae5c-2ba349d93121 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:32.106361 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-adc53d4a-baa5-4796-ae5c-2ba349d93121 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:32.106807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-adc53d4a-baa5-4796-ae5c-2ba349d93121 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:32.246962 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-adc53d4a-baa5-4796-ae5c-2ba349d93121 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:32.258053 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-adc53d4a-baa5-4796-ae5c-2ba349d93121 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.165019 Jun 22 09:00:32.258053 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 259/478] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:32 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:32.662377 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-632122ed-22f7-43a5-8bc9-bc456fafaf43 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] Calling method '.version_select at 0x7f5756db3ca0>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:32.687877 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.wsgi [None req-632122ed-22f7-43a5-8bc9-bc456fafaf43 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] HTTP exception thrown: Snapshot db01ca61-7642-4f3c-965f-67832174349a could not be found. Jun 22 09:00:32.698770 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-632122ed-22f7-43a5-8bc9-bc456fafaf43 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] Request method failure captured: Jun 22 09:00:32.698770 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: request: GET /compute/v2.1/os-snapshots/db01ca61-7642-4f3c-965f-67832174349a HTTP/1.1 Jun 22 09:00:32.698770 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept: application/json Jun 22 09:00:32.698770 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept-Encoding: identity Jun 22 09:00:32.698770 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Connection: close Jun 22 09:00:32.698770 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Length: 0 Jun 22 09:00:32.698770 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Type: application/json Jun 22 09:00:32.698770 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Host: 10.222.0.16 Jun 22 09:00:32.698770 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Openstack-System-Scope: None Jun 22 09:00:32.698770 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: User-Agent: python-urllib3/1.26.9 Jun 22 09:00:32.698770 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Auth-Token: gAAAAABistohDtAHKqG_XGgN9ojRj-qs1ZsVPq8Z3d20qUq5BUgqCLOCgbH-NgygNBVsGsnepvUfLAqVJ7WvSLjnYM3amC7o5yL6vXL8VPd0a2SCXwp091uj0IQlgoLGWQaFMmlWo2Q_OoCDLKqCkLt9AI3vj37krxPYVu1Ar4gZEJtOEJGdMBM Jun 22 09:00:32.698770 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Id: None Jun 22 09:00:32.698770 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Name: None Jun 22 09:00:32.698770 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Identity-Status: Confirmed Jun 22 09:00:32.698770 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Is-Admin-Project: True Jun 22 09:00:32.698770 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Id: default Jun 22 09:00:32.698770 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Name: Default Jun 22 09:00:32.698770 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Id: bc5b77a15c1542488764b1e592fee8d9 Jun 22 09:00:32.698770 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-994448701 Jun 22 09:00:32.698770 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Role: member,reader Jun 22 09:00:32.698770 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Roles: member,reader Jun 22 09:00:32.700203 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bc5b77a15c1542488764b1e592fee8d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bc5b77a15c1542488764b1e592fee8d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bc5b77a15c1542488764b1e592fee8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bc5b77a15c1542488764b1e592fee8d9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:00:32.700203 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant: tempest-VolumesSnapshotsTestJSON-994448701 Jun 22 09:00:32.700203 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Id: bc5b77a15c1542488764b1e592fee8d9 Jun 22 09:00:32.700203 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-994448701 Jun 22 09:00:32.700203 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User: tempest-VolumesSnapshotsTestJSON-994448701-project Jun 22 09:00:32.700203 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Id: default Jun 22 09:00:32.700203 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Name: Default Jun 22 09:00:32.700203 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Id: ea6d19ae2a5b420abbf2081f6c0f7740 Jun 22 09:00:32.700203 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Name: tempest-VolumesSnapshotsTestJSON-994448701-project Jun 22 09:00:32.700203 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: method: Jun 22 09:00:32.700203 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: exception: Snapshot db01ca61-7642-4f3c-965f-67832174349a could not be found. Jun 22 09:00:32.700203 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: action_args: {'id': 'db01ca61-7642-4f3c-965f-67832174349a'} Jun 22 09:00:32.700203 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:00:32.701145 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:32.701145 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 22 09:00:32.701145 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 22 09:00:32.701145 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 22 09:00:32.701145 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 22 09:00:32.701145 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 22 09:00:32.701145 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 22 09:00:32.701145 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 09:00:32.701145 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 09:00:32.701145 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 09:00:32.701145 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 09:00:32.701145 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:00:32.701145 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:00:32.701145 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:00:32.701145 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:00:32.701145 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot db01ca61-7642-4f3c-965f-67832174349a could not be found. (HTTP 404) (Request-ID: req-fe3a8353-85a2-49cb-950f-b0f65ae4ac7c) Jun 22 09:00:32.701145 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:32.701145 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:32.702326 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:32.702326 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:32.702326 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 22 09:00:32.702326 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 22 09:00:32.702326 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 09:00:32.702326 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 09:00:32.702326 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 22 09:00:32.702326 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 22 09:00:32.702326 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 09:00:32.702326 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 09:00:32.702326 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 22 09:00:32.702326 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 22 09:00:32.702326 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 22 09:00:32.702326 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 22 09:00:32.702326 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 22 09:00:32.702326 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 22 09:00:32.702326 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 09:00:32.702326 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 09:00:32.702326 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 09:00:32.703550 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 09:00:32.703550 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:00:32.703550 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:00:32.703550 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:00:32.703550 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:00:32.703550 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot db01ca61-7642-4f3c-965f-67832174349a could not be found. Jun 22 09:00:32.703550 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:32.703550 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:32.703550 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:32.703550 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:32.703550 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:32.703550 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:32.703550 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:00:32.703550 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:00:32.703550 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 09:00:32.703550 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 09:00:32.703550 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:00:32.703550 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:00:32.703550 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 22 09:00:32.703550 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:00:32.705690 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot db01ca61-7642-4f3c-965f-67832174349a could not be found. Jun 22 09:00:32.705690 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:32.705690 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:32.705690 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:32.705690 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:32.705690 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:32.705690 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:32.705690 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:00:32.705690 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:00:32.705690 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot db01ca61-7642-4f3c-965f-67832174349a could not be found. Jun 22 09:00:32.705690 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:32.705690 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-632122ed-22f7-43a5-8bc9-bc456fafaf43 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] Returning 404 to user: Snapshot db01ca61-7642-4f3c-965f-67832174349a could not be found. {{(pid=118024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:00:32.705690 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-632122ed-22f7-43a5-8bc9-bc456fafaf43 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/db01ca61-7642-4f3c-965f-67832174349a" status: 404 len: 111 microversion: 2.1 time: 0.033825 Jun 22 09:00:32.705690 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 220/479] 10.222.0.16 () {58 vars in 1250 bytes} [Wed Jun 22 09:00:32 2022] GET /compute/v2.1/os-snapshots/db01ca61-7642-4f3c-965f-67832174349a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:00:32.706718 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-bbefadea-c7ac-4bf9-9c76-6ddf05bbe350 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] Calling method '.version_select at 0x7f57563c10d0>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:32.900503 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-bbefadea-c7ac-4bf9-9c76-6ddf05bbe350 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/86e09d16-c3ef-4eb8-9f4f-e4e1f5753130" status: 202 len: 0 microversion: 2.1 time: 0.203311 Jun 22 09:00:32.901117 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 260/480] 10.222.0.16 () {58 vars in 1247 bytes} [Wed Jun 22 09:00:32 2022] DELETE /compute/v2.1/os-volumes/86e09d16-c3ef-4eb8-9f4f-e4e1f5753130 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:00:32.909771 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a8f8e7c2-04ab-48f4-8e4d-d74b287dcf53 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] Calling method '.version_select at 0x7f5756b4f280>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:32.962232 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a8f8e7c2-04ab-48f4-8e4d-d74b287dcf53 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/86e09d16-c3ef-4eb8-9f4f-e4e1f5753130" status: 200 len: 345 microversion: 2.1 time: 0.056538 Jun 22 09:00:32.962816 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 221/481] 10.222.0.16 () {58 vars in 1244 bytes} [Wed Jun 22 09:00:32 2022] GET /compute/v2.1/os-volumes/86e09d16-c3ef-4eb8-9f4f-e4e1f5753130 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:32.995058 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e3f08294-612e-427a-a258-26e0138f9457 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:32.995794 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e3f08294-612e-427a-a258-26e0138f9457 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:33.002651 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e3f08294-612e-427a-a258-26e0138f9457 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:33.003171 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e3f08294-612e-427a-a258-26e0138f9457 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:33.004011 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e3f08294-612e-427a-a258-26e0138f9457 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:33.004519 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e3f08294-612e-427a-a258-26e0138f9457 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:33.133210 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-e3f08294-612e-427a-a258-26e0138f9457 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:33.141037 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e3f08294-612e-427a-a258-26e0138f9457 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 200 len: 1313 microversion: 2.1 time: 0.149815 Jun 22 09:00:33.141606 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 261/482] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:32 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:33.271203 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell0:SELECT=2 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:33.272414 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell0:SELECT=8 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:33.276555 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-cf7d3ab8-f519-4d0c-879e-67036eb35d95 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:33.277405 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-cf7d3ab8-f519-4d0c-879e-67036eb35d95 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:33.283735 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cf7d3ab8-f519-4d0c-879e-67036eb35d95 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:33.284186 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cf7d3ab8-f519-4d0c-879e-67036eb35d95 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:33.284997 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cf7d3ab8-f519-4d0c-879e-67036eb35d95 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:33.285445 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cf7d3ab8-f519-4d0c-879e-67036eb35d95 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:33.433161 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-cf7d3ab8-f519-4d0c-879e-67036eb35d95 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:33.441766 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-cf7d3ab8-f519-4d0c-879e-67036eb35d95 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.171276 Jun 22 09:00:33.442332 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 222/483] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:33 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:33.510961 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-a915a393-4b45-4881-a7d3-eb347a715a00 req-151fc974-f504-43ae-aaa5-53cf7449ad7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0938f471-43b6-42e5-be5e-ac1412071021", "tag": "cb309164-11cc-4525-b3bc-ecaf1ae813f4"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:33.519452 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-a915a393-4b45-4881-a7d3-eb347a715a00 req-151fc974-f504-43ae-aaa5-53cf7449ad7a service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:33.519905 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-a915a393-4b45-4881-a7d3-eb347a715a00 req-151fc974-f504-43ae-aaa5-53cf7449ad7a service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:33.531177 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-a915a393-4b45-4881-a7d3-eb347a715a00 req-151fc974-f504-43ae-aaa5-53cf7449ad7a service nova] Creating event network-changed:cb309164-11cc-4525-b3bc-ecaf1ae813f4 for instance 0938f471-43b6-42e5-be5e-ac1412071021 on hv-cinder-84599 Jun 22 09:00:33.536597 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-a915a393-4b45-4881-a7d3-eb347a715a00 req-151fc974-f504-43ae-aaa5-53cf7449ad7a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029353 Jun 22 09:00:33.537234 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 262/484] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:33.975977 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6fd2fbcd-15a9-4856-8941-05de0a766bbc tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] Calling method '.version_select at 0x7f5756c54040>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:34.005274 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.wsgi [None req-6fd2fbcd-15a9-4856-8941-05de0a766bbc tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] HTTP exception thrown: Volume 86e09d16-c3ef-4eb8-9f4f-e4e1f5753130 could not be found. Jun 22 09:00:34.007263 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6fd2fbcd-15a9-4856-8941-05de0a766bbc tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] Request method failure captured: Jun 22 09:00:34.007263 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: request: GET /compute/v2.1/os-volumes/86e09d16-c3ef-4eb8-9f4f-e4e1f5753130 HTTP/1.1 Jun 22 09:00:34.007263 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept: application/json Jun 22 09:00:34.007263 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept-Encoding: identity Jun 22 09:00:34.007263 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Connection: close Jun 22 09:00:34.007263 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Length: 0 Jun 22 09:00:34.007263 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Type: application/json Jun 22 09:00:34.007263 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Host: 10.222.0.16 Jun 22 09:00:34.007263 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Openstack-System-Scope: None Jun 22 09:00:34.007263 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: User-Agent: python-urllib3/1.26.9 Jun 22 09:00:34.007263 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Auth-Token: gAAAAABistohDtAHKqG_XGgN9ojRj-qs1ZsVPq8Z3d20qUq5BUgqCLOCgbH-NgygNBVsGsnepvUfLAqVJ7WvSLjnYM3amC7o5yL6vXL8VPd0a2SCXwp091uj0IQlgoLGWQaFMmlWo2Q_OoCDLKqCkLt9AI3vj37krxPYVu1Ar4gZEJtOEJGdMBM Jun 22 09:00:34.007263 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Id: None Jun 22 09:00:34.007263 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Name: None Jun 22 09:00:34.007263 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Identity-Status: Confirmed Jun 22 09:00:34.007263 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Is-Admin-Project: True Jun 22 09:00:34.007263 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Id: default Jun 22 09:00:34.007263 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Name: Default Jun 22 09:00:34.007263 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Id: bc5b77a15c1542488764b1e592fee8d9 Jun 22 09:00:34.007263 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-994448701 Jun 22 09:00:34.007263 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Role: member,reader Jun 22 09:00:34.007263 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Roles: member,reader Jun 22 09:00:34.008682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bc5b77a15c1542488764b1e592fee8d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bc5b77a15c1542488764b1e592fee8d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bc5b77a15c1542488764b1e592fee8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bc5b77a15c1542488764b1e592fee8d9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:00:34.008682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant: tempest-VolumesSnapshotsTestJSON-994448701 Jun 22 09:00:34.008682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Id: bc5b77a15c1542488764b1e592fee8d9 Jun 22 09:00:34.008682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-994448701 Jun 22 09:00:34.008682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User: tempest-VolumesSnapshotsTestJSON-994448701-project Jun 22 09:00:34.008682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Id: default Jun 22 09:00:34.008682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Name: Default Jun 22 09:00:34.008682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Id: ea6d19ae2a5b420abbf2081f6c0f7740 Jun 22 09:00:34.008682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Name: tempest-VolumesSnapshotsTestJSON-994448701-project Jun 22 09:00:34.008682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: method: Jun 22 09:00:34.008682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: exception: Volume 86e09d16-c3ef-4eb8-9f4f-e4e1f5753130 could not be found. Jun 22 09:00:34.008682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: action_args: {'id': '86e09d16-c3ef-4eb8-9f4f-e4e1f5753130'} Jun 22 09:00:34.008682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:00:34.009627 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:34.009627 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:00:34.009627 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:00:34.009627 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 09:00:34.009627 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 09:00:34.009627 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 09:00:34.009627 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 09:00:34.009627 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 09:00:34.009627 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 09:00:34.009627 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 09:00:34.009627 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 09:00:34.009627 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:00:34.009627 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:00:34.009627 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:00:34.009627 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:00:34.009627 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 86e09d16-c3ef-4eb8-9f4f-e4e1f5753130 could not be found. (HTTP 404) (Request-ID: req-b16f25b5-276a-426b-bcbc-beae3403abf7) Jun 22 09:00:34.009627 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:34.009627 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:34.009627 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:34.010898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:34.010898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 09:00:34.010898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 09:00:34.010898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 09:00:34.010898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 09:00:34.010898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 09:00:34.010898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 09:00:34.010898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 09:00:34.010898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 09:00:34.010898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:00:34.010898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:00:34.010898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 09:00:34.010898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 09:00:34.010898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 09:00:34.010898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 09:00:34.010898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 09:00:34.010898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 09:00:34.010898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 09:00:34.010898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 09:00:34.012213 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:00:34.012213 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:00:34.012213 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:00:34.012213 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:00:34.012213 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 86e09d16-c3ef-4eb8-9f4f-e4e1f5753130 could not be found. Jun 22 09:00:34.012213 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:34.012213 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:34.012213 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:34.012213 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:34.012213 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:34.012213 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:34.012213 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:00:34.012213 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:00:34.012213 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 09:00:34.012213 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 09:00:34.012213 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:00:34.012213 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:00:34.012213 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 09:00:34.012213 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:00:34.013355 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 86e09d16-c3ef-4eb8-9f4f-e4e1f5753130 could not be found. Jun 22 09:00:34.013355 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:34.013355 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:34.013355 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:34.013355 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:34.013355 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:34.013355 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:34.013355 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:00:34.013355 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:00:34.013355 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 86e09d16-c3ef-4eb8-9f4f-e4e1f5753130 could not be found. Jun 22 09:00:34.013355 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:34.013355 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6fd2fbcd-15a9-4856-8941-05de0a766bbc tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] Returning 404 to user: Volume 86e09d16-c3ef-4eb8-9f4f-e4e1f5753130 could not be found. {{(pid=118024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:00:34.013355 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-6fd2fbcd-15a9-4856-8941-05de0a766bbc tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/86e09d16-c3ef-4eb8-9f4f-e4e1f5753130" status: 404 len: 109 microversion: 2.1 time: 0.036731 Jun 22 09:00:34.013355 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 223/485] 10.222.0.16 () {58 vars in 1244 bytes} [Wed Jun 22 09:00:33 2022] GET /compute/v2.1/os-volumes/86e09d16-c3ef-4eb8-9f4f-e4e1f5753130 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:00:34.024663 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-55caa979-5a4f-4cf5-a883-a530b3af1354 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] Calling method '.version_select at 0x7f57563c1820>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:34.058866 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.wsgi [None req-55caa979-5a4f-4cf5-a883-a530b3af1354 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] HTTP exception thrown: Volume 86e09d16-c3ef-4eb8-9f4f-e4e1f5753130 could not be found. Jun 22 09:00:34.063819 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-55caa979-5a4f-4cf5-a883-a530b3af1354 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] Request method failure captured: Jun 22 09:00:34.063819 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: request: DELETE /compute/v2.1/os-volumes/86e09d16-c3ef-4eb8-9f4f-e4e1f5753130 HTTP/1.1 Jun 22 09:00:34.063819 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept: application/json Jun 22 09:00:34.063819 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept-Encoding: identity Jun 22 09:00:34.063819 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Connection: close Jun 22 09:00:34.063819 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Length: 0 Jun 22 09:00:34.063819 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Type: application/json Jun 22 09:00:34.063819 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Host: 10.222.0.16 Jun 22 09:00:34.063819 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Openstack-System-Scope: None Jun 22 09:00:34.063819 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: User-Agent: python-urllib3/1.26.9 Jun 22 09:00:34.063819 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Auth-Token: gAAAAABistohDtAHKqG_XGgN9ojRj-qs1ZsVPq8Z3d20qUq5BUgqCLOCgbH-NgygNBVsGsnepvUfLAqVJ7WvSLjnYM3amC7o5yL6vXL8VPd0a2SCXwp091uj0IQlgoLGWQaFMmlWo2Q_OoCDLKqCkLt9AI3vj37krxPYVu1Ar4gZEJtOEJGdMBM Jun 22 09:00:34.063819 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Id: None Jun 22 09:00:34.063819 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Name: None Jun 22 09:00:34.063819 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Identity-Status: Confirmed Jun 22 09:00:34.063819 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Is-Admin-Project: True Jun 22 09:00:34.063819 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Id: default Jun 22 09:00:34.063819 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Name: Default Jun 22 09:00:34.063819 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Id: bc5b77a15c1542488764b1e592fee8d9 Jun 22 09:00:34.063819 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-994448701 Jun 22 09:00:34.063819 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Role: member,reader Jun 22 09:00:34.063819 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Roles: member,reader Jun 22 09:00:34.065252 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bc5b77a15c1542488764b1e592fee8d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bc5b77a15c1542488764b1e592fee8d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bc5b77a15c1542488764b1e592fee8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bc5b77a15c1542488764b1e592fee8d9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:00:34.065252 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant: tempest-VolumesSnapshotsTestJSON-994448701 Jun 22 09:00:34.065252 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Id: bc5b77a15c1542488764b1e592fee8d9 Jun 22 09:00:34.065252 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-994448701 Jun 22 09:00:34.065252 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User: tempest-VolumesSnapshotsTestJSON-994448701-project Jun 22 09:00:34.065252 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Id: default Jun 22 09:00:34.065252 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Name: Default Jun 22 09:00:34.065252 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Id: ea6d19ae2a5b420abbf2081f6c0f7740 Jun 22 09:00:34.065252 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Name: tempest-VolumesSnapshotsTestJSON-994448701-project Jun 22 09:00:34.065252 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: method: Jun 22 09:00:34.065252 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: exception: Volume 86e09d16-c3ef-4eb8-9f4f-e4e1f5753130 could not be found. Jun 22 09:00:34.065252 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: action_args: {'id': '86e09d16-c3ef-4eb8-9f4f-e4e1f5753130'} Jun 22 09:00:34.065252 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:00:34.066112 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:34.066112 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:00:34.066112 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:00:34.066112 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 09:00:34.066112 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 09:00:34.066112 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 09:00:34.066112 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 09:00:34.066112 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 09:00:34.066112 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 09:00:34.066112 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 09:00:34.066112 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 09:00:34.066112 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:00:34.066112 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:00:34.066112 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:00:34.066112 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:00:34.066112 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 86e09d16-c3ef-4eb8-9f4f-e4e1f5753130 could not be found. (HTTP 404) (Request-ID: req-e4266e28-a28a-477f-a92c-575347463985) Jun 22 09:00:34.066112 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:00:34.066112 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:34.066112 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:00:34.067312 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:34.067312 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 22 09:00:34.067312 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 22 09:00:34.067312 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 09:00:34.067312 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 09:00:34.067312 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 09:00:34.067312 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 09:00:34.067312 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 09:00:34.067312 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 09:00:34.067312 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:00:34.067312 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:00:34.067312 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 09:00:34.067312 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 09:00:34.067312 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 09:00:34.067312 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 09:00:34.067312 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 09:00:34.067312 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 09:00:34.067312 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 09:00:34.067312 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 09:00:34.068570 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:00:34.068570 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:00:34.068570 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:00:34.068570 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:00:34.068570 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 86e09d16-c3ef-4eb8-9f4f-e4e1f5753130 could not be found. Jun 22 09:00:34.068570 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:00:34.068570 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:34.068570 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:00:34.068570 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:34.068570 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:34.068570 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:34.068570 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:00:34.068570 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:00:34.068570 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 09:00:34.068570 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 09:00:34.068570 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:00:34.068570 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:00:34.068570 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 22 09:00:34.068570 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:00:34.070026 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 86e09d16-c3ef-4eb8-9f4f-e4e1f5753130 could not be found. Jun 22 09:00:34.070026 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:00:34.070026 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:34.070026 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:00:34.070026 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:34.070026 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:34.070026 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:34.070026 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:00:34.070026 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:00:34.070026 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 86e09d16-c3ef-4eb8-9f4f-e4e1f5753130 could not be found. Jun 22 09:00:34.070026 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:00:34.070026 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-55caa979-5a4f-4cf5-a883-a530b3af1354 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] Returning 404 to user: Volume 86e09d16-c3ef-4eb8-9f4f-e4e1f5753130 could not be found. {{(pid=118025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:00:34.070026 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-55caa979-5a4f-4cf5-a883-a530b3af1354 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/86e09d16-c3ef-4eb8-9f4f-e4e1f5753130" status: 404 len: 109 microversion: 2.1 time: 0.045328 Jun 22 09:00:34.070026 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 263/486] 10.222.0.16 () {58 vars in 1247 bytes} [Wed Jun 22 09:00:34 2022] DELETE /compute/v2.1/os-volumes/86e09d16-c3ef-4eb8-9f4f-e4e1f5753130 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:00:34.074313 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-0ddd0f35-f812-416b-bf18-93f159a37902 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] Calling method '.version_select at 0x7f5756b2c700>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:34.103235 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.wsgi [None req-0ddd0f35-f812-416b-bf18-93f159a37902 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] HTTP exception thrown: Volume 86e09d16-c3ef-4eb8-9f4f-e4e1f5753130 could not be found. Jun 22 09:00:34.105216 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-0ddd0f35-f812-416b-bf18-93f159a37902 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] Request method failure captured: Jun 22 09:00:34.105216 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: request: GET /compute/v2.1/os-volumes/86e09d16-c3ef-4eb8-9f4f-e4e1f5753130 HTTP/1.1 Jun 22 09:00:34.105216 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept: application/json Jun 22 09:00:34.105216 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept-Encoding: identity Jun 22 09:00:34.105216 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Connection: close Jun 22 09:00:34.105216 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Length: 0 Jun 22 09:00:34.105216 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Type: application/json Jun 22 09:00:34.105216 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Host: 10.222.0.16 Jun 22 09:00:34.105216 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Openstack-System-Scope: None Jun 22 09:00:34.105216 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: User-Agent: python-urllib3/1.26.9 Jun 22 09:00:34.105216 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Auth-Token: gAAAAABistohDtAHKqG_XGgN9ojRj-qs1ZsVPq8Z3d20qUq5BUgqCLOCgbH-NgygNBVsGsnepvUfLAqVJ7WvSLjnYM3amC7o5yL6vXL8VPd0a2SCXwp091uj0IQlgoLGWQaFMmlWo2Q_OoCDLKqCkLt9AI3vj37krxPYVu1Ar4gZEJtOEJGdMBM Jun 22 09:00:34.105216 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Id: None Jun 22 09:00:34.105216 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Name: None Jun 22 09:00:34.105216 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Identity-Status: Confirmed Jun 22 09:00:34.105216 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Is-Admin-Project: True Jun 22 09:00:34.105216 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Id: default Jun 22 09:00:34.105216 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Name: Default Jun 22 09:00:34.105216 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Id: bc5b77a15c1542488764b1e592fee8d9 Jun 22 09:00:34.105216 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-994448701 Jun 22 09:00:34.105216 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Role: member,reader Jun 22 09:00:34.105216 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Roles: member,reader Jun 22 09:00:34.106617 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bc5b77a15c1542488764b1e592fee8d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bc5b77a15c1542488764b1e592fee8d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bc5b77a15c1542488764b1e592fee8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bc5b77a15c1542488764b1e592fee8d9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:00:34.106617 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant: tempest-VolumesSnapshotsTestJSON-994448701 Jun 22 09:00:34.106617 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Id: bc5b77a15c1542488764b1e592fee8d9 Jun 22 09:00:34.106617 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-994448701 Jun 22 09:00:34.106617 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User: tempest-VolumesSnapshotsTestJSON-994448701-project Jun 22 09:00:34.106617 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Id: default Jun 22 09:00:34.106617 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Name: Default Jun 22 09:00:34.106617 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Id: ea6d19ae2a5b420abbf2081f6c0f7740 Jun 22 09:00:34.106617 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Name: tempest-VolumesSnapshotsTestJSON-994448701-project Jun 22 09:00:34.106617 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: method: Jun 22 09:00:34.106617 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: exception: Volume 86e09d16-c3ef-4eb8-9f4f-e4e1f5753130 could not be found. Jun 22 09:00:34.106617 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: action_args: {'id': '86e09d16-c3ef-4eb8-9f4f-e4e1f5753130'} Jun 22 09:00:34.106617 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:00:34.107427 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:34.107427 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:00:34.107427 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:00:34.107427 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 09:00:34.107427 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 09:00:34.107427 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 09:00:34.107427 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 09:00:34.107427 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 09:00:34.107427 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 09:00:34.107427 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 09:00:34.107427 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 09:00:34.107427 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:00:34.107427 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:00:34.107427 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:00:34.107427 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:00:34.107427 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 86e09d16-c3ef-4eb8-9f4f-e4e1f5753130 could not be found. (HTTP 404) (Request-ID: req-650760ed-23b5-4ddf-a095-62e434c0ee5e) Jun 22 09:00:34.107427 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:34.107427 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:34.107427 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:34.108654 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:34.108654 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 09:00:34.108654 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 09:00:34.108654 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 09:00:34.108654 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 09:00:34.108654 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 09:00:34.108654 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 09:00:34.108654 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 09:00:34.108654 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 09:00:34.108654 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:00:34.108654 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:00:34.108654 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 09:00:34.108654 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 09:00:34.108654 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 09:00:34.108654 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 09:00:34.108654 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 09:00:34.108654 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 09:00:34.108654 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 09:00:34.108654 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 09:00:34.109922 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:00:34.109922 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:00:34.109922 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:00:34.109922 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:00:34.109922 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 86e09d16-c3ef-4eb8-9f4f-e4e1f5753130 could not be found. Jun 22 09:00:34.109922 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:34.109922 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:34.109922 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:34.109922 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:34.109922 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:34.109922 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:34.109922 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:00:34.109922 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:00:34.109922 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 09:00:34.109922 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 09:00:34.109922 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:00:34.109922 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:00:34.109922 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 09:00:34.109922 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:00:34.111675 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 86e09d16-c3ef-4eb8-9f4f-e4e1f5753130 could not be found. Jun 22 09:00:34.111675 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:34.111675 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:34.111675 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:34.111675 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:34.111675 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:34.111675 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:34.111675 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:00:34.111675 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:00:34.111675 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 86e09d16-c3ef-4eb8-9f4f-e4e1f5753130 could not be found. Jun 22 09:00:34.111675 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:00:34.111675 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-0ddd0f35-f812-416b-bf18-93f159a37902 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] Returning 404 to user: Volume 86e09d16-c3ef-4eb8-9f4f-e4e1f5753130 could not be found. {{(pid=118024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:00:34.111675 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-0ddd0f35-f812-416b-bf18-93f159a37902 tempest-VolumesSnapshotsTestJSON-994448701 tempest-VolumesSnapshotsTestJSON-994448701-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/86e09d16-c3ef-4eb8-9f4f-e4e1f5753130" status: 404 len: 109 microversion: 2.1 time: 0.036218 Jun 22 09:00:34.111675 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 224/487] 10.222.0.16 () {58 vars in 1244 bytes} [Wed Jun 22 09:00:34 2022] GET /compute/v2.1/os-volumes/86e09d16-c3ef-4eb8-9f4f-e4e1f5753130 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:00:34.164018 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-0c946894-8a93-4c20-a35b-2b4417fe6e8f tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:34.164742 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-0c946894-8a93-4c20-a35b-2b4417fe6e8f tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:34.172139 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0c946894-8a93-4c20-a35b-2b4417fe6e8f tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:34.172589 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0c946894-8a93-4c20-a35b-2b4417fe6e8f tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:34.174083 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0c946894-8a93-4c20-a35b-2b4417fe6e8f tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:34.174627 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0c946894-8a93-4c20-a35b-2b4417fe6e8f tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:34.317572 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-0c946894-8a93-4c20-a35b-2b4417fe6e8f tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:34.325119 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-0c946894-8a93-4c20-a35b-2b4417fe6e8f tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 200 len: 1313 microversion: 2.1 time: 0.164918 Jun 22 09:00:34.325678 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 264/488] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:34 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:34.459087 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b526b818-bed4-4bdc-8b36-3c5355491426 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:34.460273 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-b526b818-bed4-4bdc-8b36-3c5355491426 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:34.466738 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b526b818-bed4-4bdc-8b36-3c5355491426 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:34.467401 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b526b818-bed4-4bdc-8b36-3c5355491426 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:34.468396 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b526b818-bed4-4bdc-8b36-3c5355491426 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:34.469015 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b526b818-bed4-4bdc-8b36-3c5355491426 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:34.604199 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-b526b818-bed4-4bdc-8b36-3c5355491426 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:34.612040 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-b526b818-bed4-4bdc-8b36-3c5355491426 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.157395 Jun 22 09:00:34.612603 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 225/489] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:34 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:35.343060 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-82f62a4e-163b-40f3-bd19-901050778ac8 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:35.343669 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-82f62a4e-163b-40f3-bd19-901050778ac8 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:35.350504 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-82f62a4e-163b-40f3-bd19-901050778ac8 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:35.350956 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-82f62a4e-163b-40f3-bd19-901050778ac8 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:35.351726 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-82f62a4e-163b-40f3-bd19-901050778ac8 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:35.352178 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-82f62a4e-163b-40f3-bd19-901050778ac8 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:35.489963 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-82f62a4e-163b-40f3-bd19-901050778ac8 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:35.505474 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-82f62a4e-163b-40f3-bd19-901050778ac8 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 200 len: 1313 microversion: 2.1 time: 0.166281 Jun 22 09:00:35.506044 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 265/490] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:35 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:35.629420 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3db1def2-8b35-4f57-a2f4-1be91d2bca60 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:35.630162 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3db1def2-8b35-4f57-a2f4-1be91d2bca60 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:35.636752 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3db1def2-8b35-4f57-a2f4-1be91d2bca60 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:35.637230 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3db1def2-8b35-4f57-a2f4-1be91d2bca60 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:35.637991 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3db1def2-8b35-4f57-a2f4-1be91d2bca60 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:35.638425 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3db1def2-8b35-4f57-a2f4-1be91d2bca60 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:35.769075 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3db1def2-8b35-4f57-a2f4-1be91d2bca60 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:35.776843 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3db1def2-8b35-4f57-a2f4-1be91d2bca60 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.151684 Jun 22 09:00:35.777409 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 226/491] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:35 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:36.524689 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-dbd4a028-19de-4b80-ab43-8de4ecd86708 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:36.526177 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-dbd4a028-19de-4b80-ab43-8de4ecd86708 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:36.534250 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dbd4a028-19de-4b80-ab43-8de4ecd86708 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:36.535398 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dbd4a028-19de-4b80-ab43-8de4ecd86708 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:36.536390 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dbd4a028-19de-4b80-ab43-8de4ecd86708 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:36.536859 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dbd4a028-19de-4b80-ab43-8de4ecd86708 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:36.670567 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-dbd4a028-19de-4b80-ab43-8de4ecd86708 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:36.678631 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-dbd4a028-19de-4b80-ab43-8de4ecd86708 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 200 len: 1313 microversion: 2.1 time: 0.160754 Jun 22 09:00:36.679193 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 266/492] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:36 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:36.797822 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a973b65c-e2dd-4497-a371-13b078719209 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:36.798567 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a973b65c-e2dd-4497-a371-13b078719209 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:36.806980 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a973b65c-e2dd-4497-a371-13b078719209 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:36.807429 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a973b65c-e2dd-4497-a371-13b078719209 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:36.808200 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a973b65c-e2dd-4497-a371-13b078719209 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:36.808644 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a973b65c-e2dd-4497-a371-13b078719209 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:36.940858 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-a973b65c-e2dd-4497-a371-13b078719209 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:36.949863 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a973b65c-e2dd-4497-a371-13b078719209 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.156292 Jun 22 09:00:36.950508 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 227/493] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:36 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:37.696004 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7b3d6019-0ffe-4a95-861a-6dcc486be210 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:37.696717 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7b3d6019-0ffe-4a95-861a-6dcc486be210 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:37.698816 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:37.703650 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7b3d6019-0ffe-4a95-861a-6dcc486be210 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:37.704194 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7b3d6019-0ffe-4a95-861a-6dcc486be210 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:37.705071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7b3d6019-0ffe-4a95-861a-6dcc486be210 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:37.705516 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7b3d6019-0ffe-4a95-861a-6dcc486be210 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:37.838151 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7b3d6019-0ffe-4a95-861a-6dcc486be210 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:37.847354 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7b3d6019-0ffe-4a95-861a-6dcc486be210 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 200 len: 1313 microversion: 2.1 time: 0.155912 Jun 22 09:00:37.848159 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 267/494] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:37 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:37.967691 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-aba37dea-7760-48ad-bbd9-dbdb8e1d43c5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:37.968336 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-aba37dea-7760-48ad-bbd9-dbdb8e1d43c5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:37.975531 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-aba37dea-7760-48ad-bbd9-dbdb8e1d43c5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:37.975985 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-aba37dea-7760-48ad-bbd9-dbdb8e1d43c5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:37.976745 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-aba37dea-7760-48ad-bbd9-dbdb8e1d43c5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:37.977269 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-aba37dea-7760-48ad-bbd9-dbdb8e1d43c5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:38.106444 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-aba37dea-7760-48ad-bbd9-dbdb8e1d43c5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:38.114741 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-aba37dea-7760-48ad-bbd9-dbdb8e1d43c5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.150896 Jun 22 09:00:38.115181 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 228/495] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:37 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:38.865306 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-5465a323-e445-402b-83be-326b6e91bc1e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:38.866018 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-5465a323-e445-402b-83be-326b6e91bc1e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:38.872576 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5465a323-e445-402b-83be-326b6e91bc1e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:38.873163 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5465a323-e445-402b-83be-326b6e91bc1e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:38.874321 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5465a323-e445-402b-83be-326b6e91bc1e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:38.874844 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5465a323-e445-402b-83be-326b6e91bc1e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:39.016261 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-5465a323-e445-402b-83be-326b6e91bc1e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:39.024275 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-5465a323-e445-402b-83be-326b6e91bc1e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 200 len: 1313 microversion: 2.1 time: 0.164232 Jun 22 09:00:39.024856 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 268/496] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:38 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:39.130717 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a30239ca-6dc7-4ab9-8562-b601b5436a59 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:39.131244 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a30239ca-6dc7-4ab9-8562-b601b5436a59 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:39.137737 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a30239ca-6dc7-4ab9-8562-b601b5436a59 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:39.141948 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a30239ca-6dc7-4ab9-8562-b601b5436a59 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:39.141948 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a30239ca-6dc7-4ab9-8562-b601b5436a59 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:39.141948 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a30239ca-6dc7-4ab9-8562-b601b5436a59 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:39.266372 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-a30239ca-6dc7-4ab9-8562-b601b5436a59 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:39.274520 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a30239ca-6dc7-4ab9-8562-b601b5436a59 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.147757 Jun 22 09:00:39.275110 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 229/497] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:39 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:40.042013 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a0bcbd49-1057-4b46-81ba-766d06b74b29 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:40.048302 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-a0bcbd49-1057-4b46-81ba-766d06b74b29 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:40.048938 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a0bcbd49-1057-4b46-81ba-766d06b74b29 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:40.049398 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a0bcbd49-1057-4b46-81ba-766d06b74b29 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:40.050167 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a0bcbd49-1057-4b46-81ba-766d06b74b29 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:40.050607 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a0bcbd49-1057-4b46-81ba-766d06b74b29 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:40.191295 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-a0bcbd49-1057-4b46-81ba-766d06b74b29 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:40.200324 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a0bcbd49-1057-4b46-81ba-766d06b74b29 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 200 len: 1313 microversion: 2.1 time: 0.162158 Jun 22 09:00:40.201551 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 269/498] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:40 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:40.292117 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1025a9fa-459b-4c3e-844f-9855923d3156 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:40.293991 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1025a9fa-459b-4c3e-844f-9855923d3156 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:40.300290 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1025a9fa-459b-4c3e-844f-9855923d3156 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:40.300743 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1025a9fa-459b-4c3e-844f-9855923d3156 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:40.301545 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1025a9fa-459b-4c3e-844f-9855923d3156 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:40.301966 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1025a9fa-459b-4c3e-844f-9855923d3156 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:40.435860 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-1025a9fa-459b-4c3e-844f-9855923d3156 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:40.444234 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1025a9fa-459b-4c3e-844f-9855923d3156 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.156459 Jun 22 09:00:40.444741 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 230/499] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:40 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:41.217497 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a3901747-590b-44cd-8a88-8600413114bc tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:41.218221 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-a3901747-590b-44cd-8a88-8600413114bc tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:41.225365 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a3901747-590b-44cd-8a88-8600413114bc tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:41.225806 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a3901747-590b-44cd-8a88-8600413114bc tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:41.226563 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a3901747-590b-44cd-8a88-8600413114bc tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:41.226993 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a3901747-590b-44cd-8a88-8600413114bc tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:41.364051 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-a3901747-590b-44cd-8a88-8600413114bc tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:41.371591 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a3901747-590b-44cd-8a88-8600413114bc tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 200 len: 1313 microversion: 2.1 time: 0.158038 Jun 22 09:00:41.372179 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 270/500] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:41 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:41.461780 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b9f676a4-1095-4c3d-a093-3ef27db41752 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:41.462454 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-b9f676a4-1095-4c3d-a093-3ef27db41752 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:41.468898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b9f676a4-1095-4c3d-a093-3ef27db41752 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:41.469315 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b9f676a4-1095-4c3d-a093-3ef27db41752 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:41.470077 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b9f676a4-1095-4c3d-a093-3ef27db41752 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:41.470512 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b9f676a4-1095-4c3d-a093-3ef27db41752 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:41.598239 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-b9f676a4-1095-4c3d-a093-3ef27db41752 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:41.605820 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-b9f676a4-1095-4c3d-a093-3ef27db41752 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.147867 Jun 22 09:00:41.606470 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 231/501] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:41 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:42.389400 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9f4d5b10-1b91-4501-b9b9-09fb0f315286 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:42.390009 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9f4d5b10-1b91-4501-b9b9-09fb0f315286 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:42.396114 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9f4d5b10-1b91-4501-b9b9-09fb0f315286 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:42.396561 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9f4d5b10-1b91-4501-b9b9-09fb0f315286 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:42.397355 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9f4d5b10-1b91-4501-b9b9-09fb0f315286 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:42.397795 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9f4d5b10-1b91-4501-b9b9-09fb0f315286 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:42.538375 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9f4d5b10-1b91-4501-b9b9-09fb0f315286 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:42.546697 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9f4d5b10-1b91-4501-b9b9-09fb0f315286 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 200 len: 1313 microversion: 2.1 time: 0.160880 Jun 22 09:00:42.547283 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 271/502] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:42 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:42.623006 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a28d51e8-4ab6-4c61-959b-425a25676d58 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:42.623624 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a28d51e8-4ab6-4c61-959b-425a25676d58 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:42.631958 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a28d51e8-4ab6-4c61-959b-425a25676d58 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:42.632418 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a28d51e8-4ab6-4c61-959b-425a25676d58 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:42.633208 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a28d51e8-4ab6-4c61-959b-425a25676d58 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:42.633641 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a28d51e8-4ab6-4c61-959b-425a25676d58 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:42.766653 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-a28d51e8-4ab6-4c61-959b-425a25676d58 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:42.774451 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a28d51e8-4ab6-4c61-959b-425a25676d58 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.155791 Jun 22 09:00:42.775009 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 232/503] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:42 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:43.463731 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-25b6cca3-c2e5-458a-b99c-2894ec0e080e req-25f935c1-c80d-4f25-8e96-85d9ca27e59a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0938f471-43b6-42e5-be5e-ac1412071021", "name": "network-vif-plugged", "status": "completed", "tag": "cb309164-11cc-4525-b3bc-ecaf1ae813f4"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:43.472999 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-25b6cca3-c2e5-458a-b99c-2894ec0e080e req-25f935c1-c80d-4f25-8e96-85d9ca27e59a service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:43.473442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-25b6cca3-c2e5-458a-b99c-2894ec0e080e req-25f935c1-c80d-4f25-8e96-85d9ca27e59a service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:43.485407 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-25b6cca3-c2e5-458a-b99c-2894ec0e080e req-25f935c1-c80d-4f25-8e96-85d9ca27e59a service nova] Creating event network-vif-plugged:cb309164-11cc-4525-b3bc-ecaf1ae813f4 for instance 0938f471-43b6-42e5-be5e-ac1412071021 on hv-cinder-84599 Jun 22 09:00:43.490911 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-25b6cca3-c2e5-458a-b99c-2894ec0e080e req-25f935c1-c80d-4f25-8e96-85d9ca27e59a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031226 Jun 22 09:00:43.491506 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 272/504] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:00:43.566918 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-5f916e27-eb75-4006-b7e5-107a8df07859 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:43.568732 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-5f916e27-eb75-4006-b7e5-107a8df07859 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:43.578263 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5f916e27-eb75-4006-b7e5-107a8df07859 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:43.578970 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5f916e27-eb75-4006-b7e5-107a8df07859 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:43.580491 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5f916e27-eb75-4006-b7e5-107a8df07859 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:43.581289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5f916e27-eb75-4006-b7e5-107a8df07859 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:43.727573 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-5f916e27-eb75-4006-b7e5-107a8df07859 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:43.729099 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-5f916e27-eb75-4006-b7e5-107a8df07859 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 200 len: 1313 microversion: 2.1 time: 0.167630 Jun 22 09:00:43.729677 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 233/505] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:43 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:43.791998 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-b547f043-bbf1-4a95-ba7f-b66e5cb93ac5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:43.792955 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-b547f043-bbf1-4a95-ba7f-b66e5cb93ac5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:43.800370 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b547f043-bbf1-4a95-ba7f-b66e5cb93ac5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:43.801098 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b547f043-bbf1-4a95-ba7f-b66e5cb93ac5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:43.801936 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b547f043-bbf1-4a95-ba7f-b66e5cb93ac5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:43.802380 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b547f043-bbf1-4a95-ba7f-b66e5cb93ac5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:43.943245 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-b547f043-bbf1-4a95-ba7f-b66e5cb93ac5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:43.949036 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-b547f043-bbf1-4a95-ba7f-b66e5cb93ac5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.161307 Jun 22 09:00:43.949606 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 273/506] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:43 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:44.746074 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-7a4d5209-eb38-4efb-bd30-7db216227df0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:44.746654 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-7a4d5209-eb38-4efb-bd30-7db216227df0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:44.748932 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:44.753749 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7a4d5209-eb38-4efb-bd30-7db216227df0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:44.754191 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7a4d5209-eb38-4efb-bd30-7db216227df0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:44.754943 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7a4d5209-eb38-4efb-bd30-7db216227df0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:44.755376 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7a4d5209-eb38-4efb-bd30-7db216227df0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:44.770821 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=100 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:44.887319 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-7a4d5209-eb38-4efb-bd30-7db216227df0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:44.896054 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-7a4d5209-eb38-4efb-bd30-7db216227df0 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 200 len: 1313 microversion: 2.1 time: 0.153879 Jun 22 09:00:44.896628 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 234/507] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:44 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:44.965938 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9cafcc74-5132-4893-a522-343f1ed6e32e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:44.966562 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9cafcc74-5132-4893-a522-343f1ed6e32e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:44.975718 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9cafcc74-5132-4893-a522-343f1ed6e32e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:44.976231 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9cafcc74-5132-4893-a522-343f1ed6e32e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:44.977148 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9cafcc74-5132-4893-a522-343f1ed6e32e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:44.977635 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9cafcc74-5132-4893-a522-343f1ed6e32e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:45.104325 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9cafcc74-5132-4893-a522-343f1ed6e32e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:45.111814 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9cafcc74-5132-4893-a522-343f1ed6e32e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.149801 Jun 22 09:00:45.112366 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 274/508] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:44 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:45.913010 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-48271a40-96eb-476f-880e-b3c73bfbbb62 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:45.913629 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-48271a40-96eb-476f-880e-b3c73bfbbb62 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:45.920037 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-48271a40-96eb-476f-880e-b3c73bfbbb62 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:45.920482 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-48271a40-96eb-476f-880e-b3c73bfbbb62 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:45.921292 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-48271a40-96eb-476f-880e-b3c73bfbbb62 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:45.921726 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-48271a40-96eb-476f-880e-b3c73bfbbb62 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:46.049081 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-48271a40-96eb-476f-880e-b3c73bfbbb62 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:46.056841 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-48271a40-96eb-476f-880e-b3c73bfbbb62 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 200 len: 1313 microversion: 2.1 time: 0.147873 Jun 22 09:00:46.057409 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 235/509] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:45 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:46.129633 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-6b3ff39a-cb87-457c-b61a-5ec23277d6a4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:46.130163 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-6b3ff39a-cb87-457c-b61a-5ec23277d6a4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:46.136247 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6b3ff39a-cb87-457c-b61a-5ec23277d6a4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:46.136704 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6b3ff39a-cb87-457c-b61a-5ec23277d6a4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:46.137515 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6b3ff39a-cb87-457c-b61a-5ec23277d6a4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:46.137957 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6b3ff39a-cb87-457c-b61a-5ec23277d6a4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:46.156364 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=100 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:46.282557 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-6b3ff39a-cb87-457c-b61a-5ec23277d6a4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:46.290160 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-6b3ff39a-cb87-457c-b61a-5ec23277d6a4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.166031 Jun 22 09:00:46.293439 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 275/510] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:46 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:47.074534 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-25b5987c-5323-4224-9ba1-4a8ccb1d659d tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:47.075266 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-25b5987c-5323-4224-9ba1-4a8ccb1d659d tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:47.082680 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-25b5987c-5323-4224-9ba1-4a8ccb1d659d tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:47.083726 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-25b5987c-5323-4224-9ba1-4a8ccb1d659d tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:47.083890 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-25b5987c-5323-4224-9ba1-4a8ccb1d659d tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:47.084330 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-25b5987c-5323-4224-9ba1-4a8ccb1d659d tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:47.219845 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-25b5987c-5323-4224-9ba1-4a8ccb1d659d tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:47.219845 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-25b5987c-5323-4224-9ba1-4a8ccb1d659d tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 200 len: 1496 microversion: 2.1 time: 0.148232 Jun 22 09:00:47.219845 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 236/511] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:47 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 1496 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:47.309092 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9deed9f9-60ae-427d-94eb-fc8f798ba327 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:47.309709 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9deed9f9-60ae-427d-94eb-fc8f798ba327 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:47.316654 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9deed9f9-60ae-427d-94eb-fc8f798ba327 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:47.317137 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9deed9f9-60ae-427d-94eb-fc8f798ba327 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:47.317912 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9deed9f9-60ae-427d-94eb-fc8f798ba327 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:47.318354 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9deed9f9-60ae-427d-94eb-fc8f798ba327 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:47.447612 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9deed9f9-60ae-427d-94eb-fc8f798ba327 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:47.455742 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9deed9f9-60ae-427d-94eb-fc8f798ba327 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.150839 Jun 22 09:00:47.456304 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 276/512] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:47 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:48.431319 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-0f17413b-9b5f-416e-9f51-44ea79357191 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:48.431847 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-0f17413b-9b5f-416e-9f51-44ea79357191 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:48.438305 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0f17413b-9b5f-416e-9f51-44ea79357191 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:48.438751 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0f17413b-9b5f-416e-9f51-44ea79357191 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:48.440305 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0f17413b-9b5f-416e-9f51-44ea79357191 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:48.440741 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0f17413b-9b5f-416e-9f51-44ea79357191 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:48.467248 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-0f17413b-9b5f-416e-9f51-44ea79357191 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Going to try to terminate instance {{(pid=118024) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:00:48.472159 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2e6ec6a9-0f21-45f0-becb-1e26bd1a5e4c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:48.472941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2e6ec6a9-0f21-45f0-becb-1e26bd1a5e4c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:48.478942 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2e6ec6a9-0f21-45f0-becb-1e26bd1a5e4c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:48.479393 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2e6ec6a9-0f21-45f0-becb-1e26bd1a5e4c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:48.480206 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2e6ec6a9-0f21-45f0-becb-1e26bd1a5e4c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:48.480641 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2e6ec6a9-0f21-45f0-becb-1e26bd1a5e4c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:48.610308 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-2e6ec6a9-0f21-45f0-becb-1e26bd1a5e4c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:48.629397 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2e6ec6a9-0f21-45f0-becb-1e26bd1a5e4c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.150719 Jun 22 09:00:48.629720 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 277/513] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:48 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:48.768615 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-0f17413b-9b5f-416e-9f51-44ea79357191 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 204 len: 0 microversion: 2.1 time: 0.340777 Jun 22 09:00:48.769130 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 237/514] 10.222.0.16 () {58 vars in 1238 bytes} [Wed Jun 22 09:00:48 2022] DELETE /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:00:48.778411 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-8ec73030-e87b-45e2-a991-89034b5fc49e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:48.779362 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-8ec73030-e87b-45e2-a991-89034b5fc49e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:48.786313 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8ec73030-e87b-45e2-a991-89034b5fc49e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:48.786834 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8ec73030-e87b-45e2-a991-89034b5fc49e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:48.787598 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8ec73030-e87b-45e2-a991-89034b5fc49e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:48.788058 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8ec73030-e87b-45e2-a991-89034b5fc49e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:48.917821 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-8ec73030-e87b-45e2-a991-89034b5fc49e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:48.926770 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-8ec73030-e87b-45e2-a991-89034b5fc49e tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 200 len: 1502 microversion: 2.1 time: 0.152081 Jun 22 09:00:48.930084 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 278/515] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:48 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:49.647307 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a36aa395-1922-4c52-80b5-4594845fb251 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:49.648201 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a36aa395-1922-4c52-80b5-4594845fb251 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:49.654707 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a36aa395-1922-4c52-80b5-4594845fb251 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:49.655147 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a36aa395-1922-4c52-80b5-4594845fb251 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:49.655898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a36aa395-1922-4c52-80b5-4594845fb251 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:49.656328 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a36aa395-1922-4c52-80b5-4594845fb251 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:49.786962 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-a36aa395-1922-4c52-80b5-4594845fb251 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:49.794332 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a36aa395-1922-4c52-80b5-4594845fb251 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.151968 Jun 22 09:00:49.794887 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 238/516] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:49 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:49.944134 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-fe0cbc7b-9c7a-4de3-9609-87575f6dfe09 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:49.944644 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-fe0cbc7b-9c7a-4de3-9609-87575f6dfe09 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:49.950895 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fe0cbc7b-9c7a-4de3-9609-87575f6dfe09 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:49.951341 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fe0cbc7b-9c7a-4de3-9609-87575f6dfe09 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:49.952091 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fe0cbc7b-9c7a-4de3-9609-87575f6dfe09 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:49.952520 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fe0cbc7b-9c7a-4de3-9609-87575f6dfe09 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:50.080994 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-fe0cbc7b-9c7a-4de3-9609-87575f6dfe09 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:50.088372 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-fe0cbc7b-9c7a-4de3-9609-87575f6dfe09 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 200 len: 1502 microversion: 2.1 time: 0.148264 Jun 22 09:00:50.088959 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 279/517] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:49 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 1502 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:50.812302 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-be20c2d4-4833-41ac-8cd2-053fe0eb783c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:50.814055 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-be20c2d4-4833-41ac-8cd2-053fe0eb783c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:50.821318 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-be20c2d4-4833-41ac-8cd2-053fe0eb783c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:50.822555 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-be20c2d4-4833-41ac-8cd2-053fe0eb783c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:50.823179 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-be20c2d4-4833-41ac-8cd2-053fe0eb783c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:50.823827 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-be20c2d4-4833-41ac-8cd2-053fe0eb783c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:50.961883 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-be20c2d4-4833-41ac-8cd2-053fe0eb783c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:50.969279 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-be20c2d4-4833-41ac-8cd2-053fe0eb783c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.161098 Jun 22 09:00:50.969843 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 239/518] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:50 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:51.105537 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-236bf2f9-d7a6-45ab-917b-2896a8fc080f tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:51.106182 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-236bf2f9-d7a6-45ab-917b-2896a8fc080f tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:51.112225 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-236bf2f9-d7a6-45ab-917b-2896a8fc080f tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:51.112931 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-236bf2f9-d7a6-45ab-917b-2896a8fc080f tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:51.114541 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-236bf2f9-d7a6-45ab-917b-2896a8fc080f tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:51.114541 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-236bf2f9-d7a6-45ab-917b-2896a8fc080f tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:51.249532 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-236bf2f9-d7a6-45ab-917b-2896a8fc080f tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:51.258554 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-236bf2f9-d7a6-45ab-917b-2896a8fc080f tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 200 len: 1502 microversion: 2.1 time: 0.156858 Jun 22 09:00:51.259158 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 280/519] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:51 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:51.986853 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-29705672-272b-415b-bb7e-f702086c0d87 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:51.987362 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-29705672-272b-415b-bb7e-f702086c0d87 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:51.993791 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-29705672-272b-415b-bb7e-f702086c0d87 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:51.994977 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-29705672-272b-415b-bb7e-f702086c0d87 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:51.994977 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-29705672-272b-415b-bb7e-f702086c0d87 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:51.995409 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-29705672-272b-415b-bb7e-f702086c0d87 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:52.125297 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-29705672-272b-415b-bb7e-f702086c0d87 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:52.133688 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-29705672-272b-415b-bb7e-f702086c0d87 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.150833 Jun 22 09:00:52.134255 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 240/520] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:51 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:52.279246 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-b1725086-c60b-43d3-8e7a-b23890efcbce tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:52.279905 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-b1725086-c60b-43d3-8e7a-b23890efcbce tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:52.286029 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b1725086-c60b-43d3-8e7a-b23890efcbce tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:52.286472 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b1725086-c60b-43d3-8e7a-b23890efcbce tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:52.287226 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b1725086-c60b-43d3-8e7a-b23890efcbce tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:52.287657 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b1725086-c60b-43d3-8e7a-b23890efcbce tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:52.419462 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-b1725086-c60b-43d3-8e7a-b23890efcbce tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:52.427554 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-b1725086-c60b-43d3-8e7a-b23890efcbce tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 200 len: 1502 microversion: 2.1 time: 0.152124 Jun 22 09:00:52.437812 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 281/521] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:52 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:52.599091 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a986ff43-3fa2-46d4-812e-223a80e942f3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3ed9a80-5f81-4c3b-9448-72043bf67404", "device": "/dev/sdb"}} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:52.600748 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a986ff43-3fa2-46d4-812e-223a80e942f3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:52.606727 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a986ff43-3fa2-46d4-812e-223a80e942f3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:52.609539 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a986ff43-3fa2-46d4-812e-223a80e942f3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:52.609539 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a986ff43-3fa2-46d4-812e-223a80e942f3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:52.609539 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a986ff43-3fa2-46d4-812e-223a80e942f3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:53.151153 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f90c8342-9d3c-492e-93e1-291afcce684f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:53.151808 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-f90c8342-9d3c-492e-93e1-291afcce684f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:53.157821 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f90c8342-9d3c-492e-93e1-291afcce684f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:53.159441 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f90c8342-9d3c-492e-93e1-291afcce684f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:53.160229 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f90c8342-9d3c-492e-93e1-291afcce684f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:53.160675 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f90c8342-9d3c-492e-93e1-291afcce684f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:53.289320 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-f90c8342-9d3c-492e-93e1-291afcce684f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:53.297282 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f90c8342-9d3c-492e-93e1-291afcce684f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.149952 Jun 22 09:00:53.297927 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 282/522] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:53 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:53.445452 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c642d6f9-367d-4846-9384-52e1094eefef tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:53.445986 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c642d6f9-367d-4846-9384-52e1094eefef tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:53.452001 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c642d6f9-367d-4846-9384-52e1094eefef tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:53.452453 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c642d6f9-367d-4846-9384-52e1094eefef tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:53.453244 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c642d6f9-367d-4846-9384-52e1094eefef tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:53.453693 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c642d6f9-367d-4846-9384-52e1094eefef tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:53.583682 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c642d6f9-367d-4846-9384-52e1094eefef tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:53.591262 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c642d6f9-367d-4846-9384-52e1094eefef tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 200 len: 1502 microversion: 2.1 time: 0.149800 Jun 22 09:00:53.592022 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 283/523] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:53 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:54.314645 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f4bcda77-78c3-41c8-a971-de9748ef026c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:54.315332 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-f4bcda77-78c3-41c8-a971-de9748ef026c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:54.321706 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f4bcda77-78c3-41c8-a971-de9748ef026c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:54.322156 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f4bcda77-78c3-41c8-a971-de9748ef026c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:54.323195 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f4bcda77-78c3-41c8-a971-de9748ef026c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:54.323333 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f4bcda77-78c3-41c8-a971-de9748ef026c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:54.450940 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-f4bcda77-78c3-41c8-a971-de9748ef026c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:54.458988 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f4bcda77-78c3-41c8-a971-de9748ef026c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.148288 Jun 22 09:00:54.459548 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 284/524] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:54 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:54.607778 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-194f27ec-bd52-455f-a53c-242d27e26592 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:54.608427 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-194f27ec-bd52-455f-a53c-242d27e26592 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:54.614574 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-194f27ec-bd52-455f-a53c-242d27e26592 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:54.615033 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-194f27ec-bd52-455f-a53c-242d27e26592 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:54.615796 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-194f27ec-bd52-455f-a53c-242d27e26592 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:54.616241 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-194f27ec-bd52-455f-a53c-242d27e26592 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:54.989337 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-194f27ec-bd52-455f-a53c-242d27e26592 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:54.996929 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-194f27ec-bd52-455f-a53c-242d27e26592 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 200 len: 1502 microversion: 2.1 time: 0.392933 Jun 22 09:00:54.997486 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 285/525] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:54 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 1502 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:55.475463 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-b4658be3-d2f5-4c7c-9083-7cbee6a5824c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:55.476019 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-b4658be3-d2f5-4c7c-9083-7cbee6a5824c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:55.482111 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b4658be3-d2f5-4c7c-9083-7cbee6a5824c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:55.482558 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b4658be3-d2f5-4c7c-9083-7cbee6a5824c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:55.483329 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b4658be3-d2f5-4c7c-9083-7cbee6a5824c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:55.483769 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b4658be3-d2f5-4c7c-9083-7cbee6a5824c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:55.614317 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-b4658be3-d2f5-4c7c-9083-7cbee6a5824c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:55.621728 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-b4658be3-d2f5-4c7c-9083-7cbee6a5824c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.150243 Jun 22 09:00:55.628388 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 286/526] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:55 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:56.015439 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2af850cf-5190-4732-948a-445b8d7f49d6 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:56.016057 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2af850cf-5190-4732-948a-445b8d7f49d6 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:56.022959 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2af850cf-5190-4732-948a-445b8d7f49d6 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:56.023418 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2af850cf-5190-4732-948a-445b8d7f49d6 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:56.024252 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2af850cf-5190-4732-948a-445b8d7f49d6 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:56.024739 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2af850cf-5190-4732-948a-445b8d7f49d6 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:56.155007 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-2af850cf-5190-4732-948a-445b8d7f49d6 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:56.163180 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2af850cf-5190-4732-948a-445b8d7f49d6 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 200 len: 1502 microversion: 2.1 time: 0.151622 Jun 22 09:00:56.163742 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 287/527] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:56 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:56.638641 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e1c6c299-aeb5-40d6-97f7-50d211d49802 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:56.639305 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e1c6c299-aeb5-40d6-97f7-50d211d49802 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:56.646015 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e1c6c299-aeb5-40d6-97f7-50d211d49802 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:56.646456 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e1c6c299-aeb5-40d6-97f7-50d211d49802 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:56.647221 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e1c6c299-aeb5-40d6-97f7-50d211d49802 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:56.647664 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e1c6c299-aeb5-40d6-97f7-50d211d49802 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:56.816747 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-e1c6c299-aeb5-40d6-97f7-50d211d49802 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:56.824445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e1c6c299-aeb5-40d6-97f7-50d211d49802 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.189939 Jun 22 09:00:56.825166 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 288/528] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:56 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:57.180321 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-acc431d1-4bb9-47f5-a5d2-97af62bce509 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:57.180973 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-acc431d1-4bb9-47f5-a5d2-97af62bce509 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:57.186910 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-acc431d1-4bb9-47f5-a5d2-97af62bce509 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:57.187339 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-acc431d1-4bb9-47f5-a5d2-97af62bce509 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:57.188090 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-acc431d1-4bb9-47f5-a5d2-97af62bce509 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:57.188528 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-acc431d1-4bb9-47f5-a5d2-97af62bce509 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:57.315843 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-acc431d1-4bb9-47f5-a5d2-97af62bce509 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:57.324598 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-acc431d1-4bb9-47f5-a5d2-97af62bce509 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 200 len: 1502 microversion: 2.1 time: 0.148315 Jun 22 09:00:57.325213 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 289/529] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:57 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 1502 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:57.841948 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2d3d917a-e3a4-4a29-9373-96a8bbfe478e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:57.842648 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2d3d917a-e3a4-4a29-9373-96a8bbfe478e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:57.853209 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2d3d917a-e3a4-4a29-9373-96a8bbfe478e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:57.853209 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2d3d917a-e3a4-4a29-9373-96a8bbfe478e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:57.853209 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2d3d917a-e3a4-4a29-9373-96a8bbfe478e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:57.853209 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2d3d917a-e3a4-4a29-9373-96a8bbfe478e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:58.035321 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-2d3d917a-e3a4-4a29-9373-96a8bbfe478e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:58.042814 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2d3d917a-e3a4-4a29-9373-96a8bbfe478e tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.204856 Jun 22 09:00:58.043454 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 290/530] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:57 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:58.344671 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-4b030159-afb1-4d5f-b7a1-6cc6b9aecf87 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:58.345503 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-4b030159-afb1-4d5f-b7a1-6cc6b9aecf87 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:58.352613 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4b030159-afb1-4d5f-b7a1-6cc6b9aecf87 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:58.353131 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4b030159-afb1-4d5f-b7a1-6cc6b9aecf87 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:58.353897 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4b030159-afb1-4d5f-b7a1-6cc6b9aecf87 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:58.354338 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4b030159-afb1-4d5f-b7a1-6cc6b9aecf87 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:58.484693 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-4b030159-afb1-4d5f-b7a1-6cc6b9aecf87 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:58.492632 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-4b030159-afb1-4d5f-b7a1-6cc6b9aecf87 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 200 len: 1502 microversion: 2.1 time: 0.151836 Jun 22 09:00:58.496253 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 291/531] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:58 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:59.060544 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-bee5af7f-783e-49d5-a7e2-db3f339b8e63 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:59.061240 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-bee5af7f-783e-49d5-a7e2-db3f339b8e63 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:59.067868 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bee5af7f-783e-49d5-a7e2-db3f339b8e63 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:59.068309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bee5af7f-783e-49d5-a7e2-db3f339b8e63 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:59.069088 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bee5af7f-783e-49d5-a7e2-db3f339b8e63 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:59.069524 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bee5af7f-783e-49d5-a7e2-db3f339b8e63 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:59.073438 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=100 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:59.209766 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-bee5af7f-783e-49d5-a7e2-db3f339b8e63 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:59.219047 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-bee5af7f-783e-49d5-a7e2-db3f339b8e63 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.162245 Jun 22 09:00:59.219931 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 292/532] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:59 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:59.511530 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-6faee2cf-cc2e-4c3c-a2b1-e2580fddfb69 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:59.512153 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-6faee2cf-cc2e-4c3c-a2b1-e2580fddfb69 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:59.518574 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6faee2cf-cc2e-4c3c-a2b1-e2580fddfb69 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:59.519259 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6faee2cf-cc2e-4c3c-a2b1-e2580fddfb69 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:59.520746 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6faee2cf-cc2e-4c3c-a2b1-e2580fddfb69 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:59.521216 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6faee2cf-cc2e-4c3c-a2b1-e2580fddfb69 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:59.662296 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-6faee2cf-cc2e-4c3c-a2b1-e2580fddfb69 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:59.669944 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-6faee2cf-cc2e-4c3c-a2b1-e2580fddfb69 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 200 len: 1502 microversion: 2.1 time: 0.162259 Jun 22 09:00:59.676156 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 293/533] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:59 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:59.771976 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a986ff43-3fa2-46d4-812e-223a80e942f3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "POST /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.177268 Jun 22 09:00:59.773553 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 241/534] 10.222.0.16 () {60 vars in 1322 bytes} [Wed Jun 22 09:00:52 2022] POST /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96/os-volume_attachments => generated 194 bytes in 7179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:59.926985 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-c5e8ed7e-c6e4-40b8-8787-b09d33992d12 req-5791fbfc-89ca-46ee-8ea5-fd4e85064d8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0938f471-43b6-42e5-be5e-ac1412071021", "name": "network-vif-deleted", "tag": "cb309164-11cc-4525-b3bc-ecaf1ae813f4"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:59.935557 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-c5e8ed7e-c6e4-40b8-8787-b09d33992d12 req-5791fbfc-89ca-46ee-8ea5-fd4e85064d8a service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:59.935999 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-c5e8ed7e-c6e4-40b8-8787-b09d33992d12 req-5791fbfc-89ca-46ee-8ea5-fd4e85064d8a service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:59.948122 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-c5e8ed7e-c6e4-40b8-8787-b09d33992d12 req-5791fbfc-89ca-46ee-8ea5-fd4e85064d8a service nova] Creating event network-vif-deleted:cb309164-11cc-4525-b3bc-ecaf1ae813f4 for instance 0938f471-43b6-42e5-be5e-ac1412071021 on hv-cinder-84599 Jun 22 09:00:59.953467 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-c5e8ed7e-c6e4-40b8-8787-b09d33992d12 req-5791fbfc-89ca-46ee-8ea5-fd4e85064d8a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030892 Jun 22 09:00:59.954054 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 294/535] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:01:00.237163 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a7cfdab3-20e1-4b88-8b5b-0dacd223a690 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:00.238042 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a7cfdab3-20e1-4b88-8b5b-0dacd223a690 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:00.245256 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a7cfdab3-20e1-4b88-8b5b-0dacd223a690 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:00.245707 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a7cfdab3-20e1-4b88-8b5b-0dacd223a690 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:00.246502 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a7cfdab3-20e1-4b88-8b5b-0dacd223a690 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:00.246938 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a7cfdab3-20e1-4b88-8b5b-0dacd223a690 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:00.406227 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-a7cfdab3-20e1-4b88-8b5b-0dacd223a690 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:00.407131 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a7cfdab3-20e1-4b88-8b5b-0dacd223a690 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.174762 Jun 22 09:01:00.407709 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 242/536] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:00 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:01:00.688348 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2b8f06e2-24bb-4154-82ae-132215802cee tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:00.689681 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2b8f06e2-24bb-4154-82ae-132215802cee tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:00.696929 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2b8f06e2-24bb-4154-82ae-132215802cee tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:00.697389 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2b8f06e2-24bb-4154-82ae-132215802cee tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:00.698163 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2b8f06e2-24bb-4154-82ae-132215802cee tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:00.698607 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2b8f06e2-24bb-4154-82ae-132215802cee tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:00.764328 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-2b8f06e2-24bb-4154-82ae-132215802cee tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:00.772054 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2b8f06e2-24bb-4154-82ae-132215802cee tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 200 len: 1460 microversion: 2.1 time: 0.088058 Jun 22 09:01:00.772629 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 295/537] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:00 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 1460 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:01.425314 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-fa180504-6a2e-4634-bace-b61734ca66ef tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:01.425881 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-fa180504-6a2e-4634-bace-b61734ca66ef tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:01.432717 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fa180504-6a2e-4634-bace-b61734ca66ef tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:01.433172 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fa180504-6a2e-4634-bace-b61734ca66ef tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:01.433926 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fa180504-6a2e-4634-bace-b61734ca66ef tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:01.434367 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fa180504-6a2e-4634-bace-b61734ca66ef tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:01.566774 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-fa180504-6a2e-4634-bace-b61734ca66ef tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:01.574553 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-fa180504-6a2e-4634-bace-b61734ca66ef tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1501 microversion: 2.1 time: 0.153481 Jun 22 09:01:01.577199 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 243/538] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:01 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1501 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:01.592072 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a40fcf83-888e-4620-8c1e-c5fcec03351d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56dde03d-b29a-4026-96aa-4d92febf4179"}} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:01:01.593304 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-a40fcf83-888e-4620-8c1e-c5fcec03351d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:01.600039 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a40fcf83-888e-4620-8c1e-c5fcec03351d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:01.600542 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a40fcf83-888e-4620-8c1e-c5fcec03351d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:01.601337 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a40fcf83-888e-4620-8c1e-c5fcec03351d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:01.601771 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a40fcf83-888e-4620-8c1e-c5fcec03351d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:01.625112 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.wsgi [None req-a40fcf83-888e-4620-8c1e-c5fcec03351d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] HTTP exception thrown: Cannot 'attach_volume' instance 713f284f-527e-4246-a442-f2d8a32428d5 while it is in vm_state rescued Jun 22 09:01:01.627042 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a40fcf83-888e-4620-8c1e-c5fcec03351d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Request method failure captured: Jun 22 09:01:01.627042 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: request: POST /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5/os-volume_attachments HTTP/1.1 Jun 22 09:01:01.627042 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept: application/json Jun 22 09:01:01.627042 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept-Encoding: identity Jun 22 09:01:01.627042 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Connection: close Jun 22 09:01:01.627042 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Length: 74 Jun 22 09:01:01.627042 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Type: application/json Jun 22 09:01:01.627042 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Host: 10.222.0.16 Jun 22 09:01:01.627042 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Openstack-System-Scope: None Jun 22 09:01:01.627042 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: User-Agent: python-urllib3/1.26.9 Jun 22 09:01:01.627042 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Auth-Token: gAAAAABistmkRR_A1SSd_DKSdmLeXfCgq8S7MTDoc5Rg_dVzj7V0Sq8HIViMmjLNjckKM4J6xg-gPY3gbXMfQytoblh_gdFPbQnFzcj16rPlrzeTOqehoqqd-eW8nblkxMTRUaTWCfvbJOUsQ24LDqfB-k6flQr9yIlEFcuMAVjS-zMIg2TYx34 Jun 22 09:01:01.627042 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Id: None Jun 22 09:01:01.627042 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Name: None Jun 22 09:01:01.627042 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Identity-Status: Confirmed Jun 22 09:01:01.627042 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Is-Admin-Project: True Jun 22 09:01:01.627042 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Id: default Jun 22 09:01:01.627042 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Name: Default Jun 22 09:01:01.627042 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Id: 4019eed8f0a140f099ca1c123ff71cef Jun 22 09:01:01.627042 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1606992120 Jun 22 09:01:01.627042 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Role: member,reader Jun 22 09:01:01.627042 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Roles: member,reader Jun 22 09:01:01.629281 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4019eed8f0a140f099ca1c123ff71cef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4019eed8f0a140f099ca1c123ff71cef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4019eed8f0a140f099ca1c123ff71cef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4019eed8f0a140f099ca1c123ff71cef", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:01:01.629281 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1606992120 Jun 22 09:01:01.629281 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Id: 4019eed8f0a140f099ca1c123ff71cef Jun 22 09:01:01.629281 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1606992120 Jun 22 09:01:01.629281 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User: tempest-ServerRescueNegativeTestJSON-1606992120-project Jun 22 09:01:01.629281 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Id: default Jun 22 09:01:01.629281 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Name: Default Jun 22 09:01:01.629281 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Id: 1a8d3cd247d743cf8c93ee15d8574602 Jun 22 09:01:01.629281 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1606992120-project Jun 22 09:01:01.629281 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Jun 22 09:01:01.629281 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: {"volumeAttachment": {"volumeId": "56dde03d-b29a-4026-96aa-4d92febf4179"}} Jun 22 09:01:01.629281 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: method: > Jun 22 09:01:01.630062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: exception: Cannot 'attach_volume' instance 713f284f-527e-4246-a442-f2d8a32428d5 while it is in vm_state rescued Jun 22 09:01:01.630062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: action_args: {'server_id': '713f284f-527e-4246-a442-f2d8a32428d5', 'body': {'volumeAttachment': {'volumeId': '56dde03d-b29a-4026-96aa-4d92febf4179'}}} Jun 22 09:01:01.630062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:01:01.630062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:01:01.630062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 22 09:01:01.630062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 22 09:01:01.630062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 09:01:01.630062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 09:01:01.630062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 22 09:01:01.630062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 22 09:01:01.630062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 713f284f-527e-4246-a442-f2d8a32428d5 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 22 09:01:01.630062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:01:01.630062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:01:01.630062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:01:01.630062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:01:01.630062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:01:01.630062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:01:01.630062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:01:01.630062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:01:01.631203 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:01:01.631203 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:01:01.631203 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 09:01:01.631203 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 09:01:01.631203 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 09:01:01.631203 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 09:01:01.631203 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 09:01:01.631203 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 09:01:01.631203 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 22 09:01:01.631203 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 22 09:01:01.631203 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 22 09:01:01.631203 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 22 09:01:01.631203 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 713f284f-527e-4246-a442-f2d8a32428d5 while it is in vm_state rescued Jun 22 09:01:01.631203 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:01:01.631203 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:01:01.631203 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:01:01.631203 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:01:01.631203 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:01:01.631203 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:01:01.632184 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:01:01.632184 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:01:01.632184 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 713f284f-527e-4246-a442-f2d8a32428d5 while it is in vm_state rescued Jun 22 09:01:01.632184 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:01:01.632184 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a40fcf83-888e-4620-8c1e-c5fcec03351d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Returning 409 to user: Cannot 'attach_volume' instance 713f284f-527e-4246-a442-f2d8a32428d5 while it is in vm_state rescued {{(pid=118025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:01:01.632184 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a40fcf83-888e-4620-8c1e-c5fcec03351d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "POST /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040722 Jun 22 09:01:01.632184 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 296/539] 10.222.0.16 () {60 vars in 1322 bytes} [Wed Jun 22 09:01:01 2022] POST /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 22 09:01:01.638679 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-bdd92b9b-6bf9-4ae8-bdd5-5a6e0bec770f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:01:01.639208 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-bdd92b9b-6bf9-4ae8-bdd5-5a6e0bec770f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:01.646149 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bdd92b9b-6bf9-4ae8-bdd5-5a6e0bec770f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:01.646599 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bdd92b9b-6bf9-4ae8-bdd5-5a6e0bec770f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:01.647369 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bdd92b9b-6bf9-4ae8-bdd5-5a6e0bec770f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:01.647848 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bdd92b9b-6bf9-4ae8-bdd5-5a6e0bec770f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:01.788566 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-143eb3db-3658-4448-a98e-c35a9316b82a tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:01.789255 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-143eb3db-3658-4448-a98e-c35a9316b82a tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:01.795262 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-143eb3db-3658-4448-a98e-c35a9316b82a tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:01.795706 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-143eb3db-3658-4448-a98e-c35a9316b82a tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:01.796456 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-143eb3db-3658-4448-a98e-c35a9316b82a tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:01.796920 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-143eb3db-3658-4448-a98e-c35a9316b82a tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:01.828073 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-143eb3db-3658-4448-a98e-c35a9316b82a tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:01.828523 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-143eb3db-3658-4448-a98e-c35a9316b82a tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:01.828996 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.objects.instance [None req-143eb3db-3658-4448-a98e-c35a9316b82a tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lazy-loading 'fault' on Instance uuid 0938f471-43b6-42e5-be5e-ac1412071021 {{(pid=118025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:01:01.846260 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-bdd92b9b-6bf9-4ae8-bdd5-5a6e0bec770f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "POST /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5/action" status: 202 len: 0 microversion: 2.1 time: 0.210831 Jun 22 09:01:01.850337 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 244/540] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jun 22 09:01:01 2022] POST /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:01:01.858154 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f0712b64-228c-4ca6-a906-4bd451285b49 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:01.859367 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f0712b64-228c-4ca6-a906-4bd451285b49 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:01.868342 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f0712b64-228c-4ca6-a906-4bd451285b49 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:01.868824 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f0712b64-228c-4ca6-a906-4bd451285b49 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:01.869636 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f0712b64-228c-4ca6-a906-4bd451285b49 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:01.870087 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f0712b64-228c-4ca6-a906-4bd451285b49 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:01.880305 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-143eb3db-3658-4448-a98e-c35a9316b82a tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3692a330bd744eb29008156ad6a546ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057f604657a84a1ab5690adec51c01c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:01.895596 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-143eb3db-3658-4448-a98e-c35a9316b82a tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 200 len: 1303 microversion: 2.1 time: 0.110570 Jun 22 09:01:01.896129 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 297/541] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:01 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 1303 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:01:02.004135 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-f0712b64-228c-4ca6-a906-4bd451285b49 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:02.014062 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f0712b64-228c-4ca6-a906-4bd451285b49 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1509 microversion: 2.1 time: 0.162320 Jun 22 09:01:02.015022 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 245/542] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:01 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:02.913119 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-0a9b47a3-7343-4fc9-9853-becaa3dd6164 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:02.913731 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-0a9b47a3-7343-4fc9-9853-becaa3dd6164 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] [instance: 0938f471-43b6-42e5-be5e-ac1412071021] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:02.920063 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0a9b47a3-7343-4fc9-9853-becaa3dd6164 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:02.925791 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0a9b47a3-7343-4fc9-9853-becaa3dd6164 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:02.925791 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0a9b47a3-7343-4fc9-9853-becaa3dd6164 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:02.925791 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0a9b47a3-7343-4fc9-9853-becaa3dd6164 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:02.936158 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.wsgi [None req-0a9b47a3-7343-4fc9-9853-becaa3dd6164 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] HTTP exception thrown: Instance 0938f471-43b6-42e5-be5e-ac1412071021 could not be found. Jun 22 09:01:02.938263 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-0a9b47a3-7343-4fc9-9853-becaa3dd6164 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Request method failure captured: Jun 22 09:01:02.938263 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: request: GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 HTTP/1.1 Jun 22 09:01:02.938263 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept: application/json Jun 22 09:01:02.938263 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept-Encoding: identity Jun 22 09:01:02.938263 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Connection: close Jun 22 09:01:02.938263 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Length: 0 Jun 22 09:01:02.938263 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Type: application/json Jun 22 09:01:02.938263 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Host: 10.222.0.16 Jun 22 09:01:02.938263 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Openstack-System-Scope: None Jun 22 09:01:02.938263 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: User-Agent: python-urllib3/1.26.9 Jun 22 09:01:02.938263 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Auth-Token: gAAAAABistnhcoABsd0qqvKCvnNhVgCkxtxqGkbkhXwBAi8HdddLEfhllFC85DUFp6QAc9Bk9ESJr46qW_EMSv0YtYBUnPyjxIG6e-qtUqcIp_3vato3x8dxgr4Fhdmy0atVPb2hQ6DbGq0SP1epgCXHGqHrYWyvx4K4yrPndbmXi2MPu0iToKk Jun 22 09:01:02.938263 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Id: None Jun 22 09:01:02.938263 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Name: None Jun 22 09:01:02.938263 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Identity-Status: Confirmed Jun 22 09:01:02.938263 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Is-Admin-Project: True Jun 22 09:01:02.938263 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Id: default Jun 22 09:01:02.938263 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Name: Default Jun 22 09:01:02.938263 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Id: 057f604657a84a1ab5690adec51c01c1 Jun 22 09:01:02.938263 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Name: tempest-VolumesActionsTest-597472862 Jun 22 09:01:02.938263 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Role: member,reader Jun 22 09:01:02.938263 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Roles: member,reader Jun 22 09:01:02.939731 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/057f604657a84a1ab5690adec51c01c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/057f604657a84a1ab5690adec51c01c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/057f604657a84a1ab5690adec51c01c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_057f604657a84a1ab5690adec51c01c1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:01:02.939731 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant: tempest-VolumesActionsTest-597472862 Jun 22 09:01:02.939731 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Id: 057f604657a84a1ab5690adec51c01c1 Jun 22 09:01:02.939731 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Name: tempest-VolumesActionsTest-597472862 Jun 22 09:01:02.939731 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User: tempest-VolumesActionsTest-597472862-project Jun 22 09:01:02.939731 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Id: default Jun 22 09:01:02.939731 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Name: Default Jun 22 09:01:02.939731 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Id: 3692a330bd744eb29008156ad6a546ce Jun 22 09:01:02.939731 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Name: tempest-VolumesActionsTest-597472862-project Jun 22 09:01:02.939731 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: method: > Jun 22 09:01:02.939731 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: exception: Instance 0938f471-43b6-42e5-be5e-ac1412071021 could not be found. Jun 22 09:01:02.939731 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: action_args: {'id': '0938f471-43b6-42e5-be5e-ac1412071021'} Jun 22 09:01:02.940442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:01:02.940442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:01:02.940442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:01:02.940442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:01:02.940442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:01:02.940442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:01:02.940442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:01:02.940442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:01:02.940442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:01:02.940442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:01:02.940442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0938f471-43b6-42e5-be5e-ac1412071021 could not be found. Jun 22 09:01:02.940442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:01:02.940442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:01:02.940442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:01:02.940442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:01:02.940442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:01:02.940442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:01:02.940442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:01:02.940442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:01:02.940442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:01:02.942897 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:01:02.942897 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:01:02.942897 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:01:02.942897 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:01:02.942897 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:01:02.942897 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:01:02.942897 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:01:02.942897 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0938f471-43b6-42e5-be5e-ac1412071021 could not be found. Jun 22 09:01:02.942897 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:01:02.942897 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:01:02.942897 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:01:02.942897 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:01:02.942897 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:01:02.942897 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:01:02.942897 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:01:02.942897 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:01:02.942897 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0938f471-43b6-42e5-be5e-ac1412071021 could not be found. Jun 22 09:01:02.942897 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:01:02.943896 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-0a9b47a3-7343-4fc9-9853-becaa3dd6164 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] Returning 404 to user: Instance 0938f471-43b6-42e5-be5e-ac1412071021 could not be found. {{(pid=118025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:01:02.943896 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-0a9b47a3-7343-4fc9-9853-becaa3dd6164 tempest-VolumesActionsTest-597472862 tempest-VolumesActionsTest-597472862-project] 10.222.0.16 "GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021" status: 404 len: 111 microversion: 2.1 time: 0.030775 Jun 22 09:01:02.943896 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 298/543] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:02 2022] GET /compute/v2.1/servers/0938f471-43b6-42e5-be5e-ac1412071021 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:01:03.031911 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-107f16d0-6d8f-45d0-8a0d-986c73b7dec5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:03.032558 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-107f16d0-6d8f-45d0-8a0d-986c73b7dec5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:03.040324 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-107f16d0-6d8f-45d0-8a0d-986c73b7dec5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:03.040829 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-107f16d0-6d8f-45d0-8a0d-986c73b7dec5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:03.041608 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-107f16d0-6d8f-45d0-8a0d-986c73b7dec5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:03.042050 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-107f16d0-6d8f-45d0-8a0d-986c73b7dec5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:03.184154 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-107f16d0-6d8f-45d0-8a0d-986c73b7dec5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:03.192175 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-107f16d0-6d8f-45d0-8a0d-986c73b7dec5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1509 microversion: 2.1 time: 0.163783 Jun 22 09:01:03.192731 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 246/544] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:03 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:04.210993 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-8490cc3e-d357-4f8a-8692-7f3676ec889b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:04.215254 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-8490cc3e-d357-4f8a-8692-7f3676ec889b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:04.218698 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8490cc3e-d357-4f8a-8692-7f3676ec889b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:04.219231 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8490cc3e-d357-4f8a-8692-7f3676ec889b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:04.220109 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8490cc3e-d357-4f8a-8692-7f3676ec889b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:04.220633 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8490cc3e-d357-4f8a-8692-7f3676ec889b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:04.353808 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-8490cc3e-d357-4f8a-8692-7f3676ec889b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:04.361270 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-8490cc3e-d357-4f8a-8692-7f3676ec889b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1509 microversion: 2.1 time: 0.154757 Jun 22 09:01:04.361816 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 299/545] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:04 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:05.378259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-eee69c8c-7b64-422d-a224-7551e504c77a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:05.378885 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-eee69c8c-7b64-422d-a224-7551e504c77a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:05.385760 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-eee69c8c-7b64-422d-a224-7551e504c77a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:05.386187 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-eee69c8c-7b64-422d-a224-7551e504c77a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:05.386939 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-eee69c8c-7b64-422d-a224-7551e504c77a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:05.387438 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-eee69c8c-7b64-422d-a224-7551e504c77a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:05.391673 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:05.525439 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-eee69c8c-7b64-422d-a224-7551e504c77a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:05.532717 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-eee69c8c-7b64-422d-a224-7551e504c77a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1509 microversion: 2.1 time: 0.158398 Jun 22 09:01:05.533524 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 247/546] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:05 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:06.551709 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-55dedaef-05ae-4499-825f-21bf4107edc6 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:06.552379 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-55dedaef-05ae-4499-825f-21bf4107edc6 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:06.558831 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-55dedaef-05ae-4499-825f-21bf4107edc6 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:06.559347 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-55dedaef-05ae-4499-825f-21bf4107edc6 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:06.560109 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-55dedaef-05ae-4499-825f-21bf4107edc6 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:06.560547 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-55dedaef-05ae-4499-825f-21bf4107edc6 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:06.687629 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-55dedaef-05ae-4499-825f-21bf4107edc6 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:06.695076 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-55dedaef-05ae-4499-825f-21bf4107edc6 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1509 microversion: 2.1 time: 0.147534 Jun 22 09:01:06.695628 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 300/547] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:06 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1509 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:07.711830 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-fe1be902-23b2-47f9-97d4-6c146b676059 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:07.712483 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-fe1be902-23b2-47f9-97d4-6c146b676059 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:07.719259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fe1be902-23b2-47f9-97d4-6c146b676059 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:07.719719 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fe1be902-23b2-47f9-97d4-6c146b676059 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:07.720485 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fe1be902-23b2-47f9-97d4-6c146b676059 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:07.720955 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fe1be902-23b2-47f9-97d4-6c146b676059 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:07.849485 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-fe1be902-23b2-47f9-97d4-6c146b676059 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:07.856953 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-fe1be902-23b2-47f9-97d4-6c146b676059 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1509 microversion: 2.1 time: 0.149352 Jun 22 09:01:07.857516 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 248/548] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:07 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:08.874297 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-87822358-2b74-4150-8c9c-47fa8ebd7c1b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:08.874909 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-87822358-2b74-4150-8c9c-47fa8ebd7c1b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:08.877012 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=70 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:08.882439 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-87822358-2b74-4150-8c9c-47fa8ebd7c1b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:08.882888 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-87822358-2b74-4150-8c9c-47fa8ebd7c1b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:08.883657 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-87822358-2b74-4150-8c9c-47fa8ebd7c1b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:08.884094 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-87822358-2b74-4150-8c9c-47fa8ebd7c1b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:09.015636 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-87822358-2b74-4150-8c9c-47fa8ebd7c1b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:09.023111 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-87822358-2b74-4150-8c9c-47fa8ebd7c1b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1509 microversion: 2.1 time: 0.152732 Jun 22 09:01:09.023670 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 301/549] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:08 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:10.040197 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f6f27dcc-298f-4e8b-8954-117d35bb610d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:10.040828 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f6f27dcc-298f-4e8b-8954-117d35bb610d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:10.046841 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f6f27dcc-298f-4e8b-8954-117d35bb610d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:10.047292 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f6f27dcc-298f-4e8b-8954-117d35bb610d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:10.048058 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f6f27dcc-298f-4e8b-8954-117d35bb610d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:10.048499 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f6f27dcc-298f-4e8b-8954-117d35bb610d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:10.185154 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-f6f27dcc-298f-4e8b-8954-117d35bb610d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:10.199406 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f6f27dcc-298f-4e8b-8954-117d35bb610d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1509 microversion: 2.1 time: 0.163515 Jun 22 09:01:10.200010 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 249/550] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:10 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:11.215419 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-999b7dfc-abcf-4eb1-85de-f42f2c6f18fc tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:11.216027 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-999b7dfc-abcf-4eb1-85de-f42f2c6f18fc tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:11.222991 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-999b7dfc-abcf-4eb1-85de-f42f2c6f18fc tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:11.223433 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-999b7dfc-abcf-4eb1-85de-f42f2c6f18fc tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:11.224186 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-999b7dfc-abcf-4eb1-85de-f42f2c6f18fc tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:11.224620 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-999b7dfc-abcf-4eb1-85de-f42f2c6f18fc tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:11.355166 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-999b7dfc-abcf-4eb1-85de-f42f2c6f18fc tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:11.363136 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-999b7dfc-abcf-4eb1-85de-f42f2c6f18fc tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1515 microversion: 2.1 time: 0.151514 Jun 22 09:01:11.363697 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 302/551] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:11 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:14.268137 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-d1e86ca1-2693-43a0-849e-2e614b45ed29 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Action: 'create', calling method: .version_select at 0x7f5756aedaf0>, body: {"keypair": {"name": "tempest-keypair-324201060", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAl/2qQwt9Z+P7/SEVrKkod88rfpGRZ1gaOb+QQGeLzNA4bfthnIzP+wWO8mwBsxi0bLTkVqKTITH+MAqTjfFqTFAOKaILjxycDZCfmp6LLdqKafMV8YTBaGU+3oaKzQOQ=="}} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:01:14.296106 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.quota [None req-d1e86ca1-2693-43a0-849e-2e614b45ed29 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Getting quotas for project 4019eed8f0a140f099ca1c123ff71cef. Resources: {'key_pairs'} {{(pid=118024) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:01:14.301461 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.quota [None req-d1e86ca1-2693-43a0-849e-2e614b45ed29 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Getting quotas for user 1a8d3cd247d743cf8c93ee15d8574602 and project 4019eed8f0a140f099ca1c123ff71cef. Resources: {'key_pairs'} {{(pid=118024) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:01:14.414678 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-d1e86ca1-2693-43a0-849e-2e614b45ed29 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.150579 Jun 22 09:01:14.415542 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 250/552] 10.222.0.16 () {60 vars in 1158 bytes} [Wed Jun 22 09:01:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:01:17.147764 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-08e2218c-030e-4d3d-a70d-fba6a774c5c4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1498455675", "imageRef": "c24d36a8-7909-4174-9b12-42c8d76647ac", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e60d8203-b0b0-4095-acaa-80276076a1ac"}], "security_groups": [{"name": "tempest-securitygroup--326831702"}], "key_name": "tempest-keypair-324201060", "user_data": "}} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:01:17.317438 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.network.neutron [None req-08e2218c-030e-4d3d-a70d-fba6a774c5c4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] validate_networks() for [('e60d8203-b0b0-4095-acaa-80276076a1ac', None, None, None, None, None)] {{(pid=118025) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:01:17.822505 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-08e2218c-030e-4d3d-a70d-fba6a774c5c4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Flavor limits 0:0:0 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:01:17.823177 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-08e2218c-030e-4d3d-a70d-fba6a774c5c4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Image limits 0:0:0 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:01:17.825028 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-08e2218c-030e-4d3d-a70d-fba6a774c5c4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Flavor pref 0:0:0 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:01:17.825028 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-08e2218c-030e-4d3d-a70d-fba6a774c5c4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Image pref 0:0:0 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:01:17.832172 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-08e2218c-030e-4d3d-a70d-fba6a774c5c4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:01:17.853642 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-08e2218c-030e-4d3d-a70d-fba6a774c5c4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:17.855303 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-08e2218c-030e-4d3d-a70d-fba6a774c5c4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:17.861431 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-08e2218c-030e-4d3d-a70d-fba6a774c5c4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:17.863334 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-08e2218c-030e-4d3d-a70d-fba6a774c5c4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:17.905139 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.quota [None req-08e2218c-030e-4d3d-a70d-fba6a774c5c4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Getting quotas for project 4019eed8f0a140f099ca1c123ff71cef. Resources: {'cores', 'instances', 'ram'} {{(pid=118025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:01:17.915032 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.quota [None req-08e2218c-030e-4d3d-a70d-fba6a774c5c4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Getting quotas for user 1a8d3cd247d743cf8c93ee15d8574602 and project 4019eed8f0a140f099ca1c123ff71cef. Resources: {'cores', 'instances', 'ram'} {{(pid=118025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:01:17.938218 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-08e2218c-030e-4d3d-a70d-fba6a774c5c4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Going to run 1 instances... {{(pid=118025) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:01:17.942157 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-08e2218c-030e-4d3d-a70d-fba6a774c5c4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c24d36a8-7909-4174-9b12-42c8d76647ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:01:18.077810 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-08e2218c-030e-4d3d-a70d-fba6a774c5c4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.934727 Jun 22 09:01:18.090607 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-08cc7cea-43cc-45fe-8ec4-1f933591a867 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:18.091271 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-08cc7cea-43cc-45fe-8ec4-1f933591a867 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:18.094065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:18.108397 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 303/553] 10.222.0.16 () {60 vars in 1146 bytes} [Wed Jun 22 09:01:17 2022] POST /compute/v2.1/servers => generated 408 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:01:18.205125 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-08cc7cea-43cc-45fe-8ec4-1f933591a867 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:18.217359 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-08cc7cea-43cc-45fe-8ec4-1f933591a867 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1245 microversion: 2.1 time: 0.130677 Jun 22 09:01:18.219190 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 251/554] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:18 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1245 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:01:19.235004 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7862bc24-bc6e-4a99-b487-a09cda6b2e6c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:19.235609 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7862bc24-bc6e-4a99-b487-a09cda6b2e6c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:19.242614 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7862bc24-bc6e-4a99-b487-a09cda6b2e6c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:19.243053 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7862bc24-bc6e-4a99-b487-a09cda6b2e6c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:19.243808 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7862bc24-bc6e-4a99-b487-a09cda6b2e6c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:19.244239 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7862bc24-bc6e-4a99-b487-a09cda6b2e6c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:19.308629 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7862bc24-bc6e-4a99-b487-a09cda6b2e6c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:19.317501 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7862bc24-bc6e-4a99-b487-a09cda6b2e6c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1249 microversion: 2.1 time: 0.086334 Jun 22 09:01:19.322514 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 304/555] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:19 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1249 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:20.335548 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3a64e84b-ca72-4cab-b944-a30f2ad7d5ce tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:20.336144 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3a64e84b-ca72-4cab-b944-a30f2ad7d5ce tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:20.338456 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=17 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:20.343332 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3a64e84b-ca72-4cab-b944-a30f2ad7d5ce tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:20.343781 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3a64e84b-ca72-4cab-b944-a30f2ad7d5ce tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:20.344541 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3a64e84b-ca72-4cab-b944-a30f2ad7d5ce tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:20.345011 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3a64e84b-ca72-4cab-b944-a30f2ad7d5ce tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:20.405742 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3a64e84b-ca72-4cab-b944-a30f2ad7d5ce tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:20.413061 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3a64e84b-ca72-4cab-b944-a30f2ad7d5ce tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1241 microversion: 2.1 time: 0.082359 Jun 22 09:01:20.413624 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 252/556] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:20 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:21.430429 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-6caf2be7-e4ec-4a3c-98f4-baed4cd34ecb tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:21.431041 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-6caf2be7-e4ec-4a3c-98f4-baed4cd34ecb tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:21.437101 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6caf2be7-e4ec-4a3c-98f4-baed4cd34ecb tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:21.437548 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6caf2be7-e4ec-4a3c-98f4-baed4cd34ecb tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:21.438305 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6caf2be7-e4ec-4a3c-98f4-baed4cd34ecb tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:21.438737 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6caf2be7-e4ec-4a3c-98f4-baed4cd34ecb tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:21.501356 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-6caf2be7-e4ec-4a3c-98f4-baed4cd34ecb tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:21.508707 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-6caf2be7-e4ec-4a3c-98f4-baed4cd34ecb tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1241 microversion: 2.1 time: 0.082401 Jun 22 09:01:21.509294 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 305/557] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:21 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:22.525481 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-7f173d7a-d429-4273-91ee-4fe241d2bc54 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:22.526012 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-7f173d7a-d429-4273-91ee-4fe241d2bc54 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:22.532472 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7f173d7a-d429-4273-91ee-4fe241d2bc54 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:22.532952 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7f173d7a-d429-4273-91ee-4fe241d2bc54 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:22.533709 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7f173d7a-d429-4273-91ee-4fe241d2bc54 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:22.534143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7f173d7a-d429-4273-91ee-4fe241d2bc54 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:22.594894 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-7f173d7a-d429-4273-91ee-4fe241d2bc54 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:22.603075 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-7f173d7a-d429-4273-91ee-4fe241d2bc54 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1241 microversion: 2.1 time: 0.081641 Jun 22 09:01:22.603639 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 253/558] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:22 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:23.620373 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-014d5908-c584-45b6-9ddb-92b3ef23fef3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:23.621020 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-014d5908-c584-45b6-9ddb-92b3ef23fef3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:23.627338 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-014d5908-c584-45b6-9ddb-92b3ef23fef3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:23.627785 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-014d5908-c584-45b6-9ddb-92b3ef23fef3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:23.628535 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-014d5908-c584-45b6-9ddb-92b3ef23fef3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:23.629874 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-014d5908-c584-45b6-9ddb-92b3ef23fef3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:23.715940 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-014d5908-c584-45b6-9ddb-92b3ef23fef3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:23.724251 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-014d5908-c584-45b6-9ddb-92b3ef23fef3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1241 microversion: 2.1 time: 0.107908 Jun 22 09:01:23.724959 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 306/559] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:23 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1241 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:01:24.742074 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-7b299617-41c2-43f5-b81a-7ade4fcc8566 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:24.742680 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-7b299617-41c2-43f5-b81a-7ade4fcc8566 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:24.749662 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7b299617-41c2-43f5-b81a-7ade4fcc8566 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:24.750375 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7b299617-41c2-43f5-b81a-7ade4fcc8566 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:24.751361 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7b299617-41c2-43f5-b81a-7ade4fcc8566 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:24.751795 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7b299617-41c2-43f5-b81a-7ade4fcc8566 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:24.819384 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-7b299617-41c2-43f5-b81a-7ade4fcc8566 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:24.827607 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-7b299617-41c2-43f5-b81a-7ade4fcc8566 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1305 microversion: 2.1 time: 0.090112 Jun 22 09:01:24.837885 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 254/560] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:24 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1305 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:25.845304 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-bfb758e4-f355-4f16-837b-8c557f62b9ab tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:25.846681 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-bfb758e4-f355-4f16-837b-8c557f62b9ab tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:25.854002 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bfb758e4-f355-4f16-837b-8c557f62b9ab tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:25.854827 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bfb758e4-f355-4f16-837b-8c557f62b9ab tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:25.855907 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bfb758e4-f355-4f16-837b-8c557f62b9ab tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:25.856572 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bfb758e4-f355-4f16-837b-8c557f62b9ab tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:26.051112 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-bfb758e4-f355-4f16-837b-8c557f62b9ab tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:26.060820 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-bfb758e4-f355-4f16-837b-8c557f62b9ab tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1370 microversion: 2.1 time: 0.219416 Jun 22 09:01:26.061895 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 307/561] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:25 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1370 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:26.789990 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [req-df1aba25-0fef-4a45-ae4f-688754a35add req-9ff32293-0a3c-4d66-8961-dd4089d24809 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcbd1c7d-a978-447a-bf3e-bc4e579e0e45", "tag": "f2c5416a-4e17-4d7a-8b60-2e6a9f411ddd"}]} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:01:26.802412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-df1aba25-0fef-4a45-ae4f-688754a35add req-9ff32293-0a3c-4d66-8961-dd4089d24809 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:26.802887 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-df1aba25-0fef-4a45-ae4f-688754a35add req-9ff32293-0a3c-4d66-8961-dd4089d24809 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:26.821041 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.compute.server_external_events [req-df1aba25-0fef-4a45-ae4f-688754a35add req-9ff32293-0a3c-4d66-8961-dd4089d24809 service nova] Creating event network-changed:f2c5416a-4e17-4d7a-8b60-2e6a9f411ddd for instance bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 on hv-cinder-84599 Jun 22 09:01:26.826286 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [req-df1aba25-0fef-4a45-ae4f-688754a35add req-9ff32293-0a3c-4d66-8961-dd4089d24809 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041715 Jun 22 09:01:26.830694 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 255/562] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:01:27.092277 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-182636c2-821f-4294-a8ee-eb529257b048 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:27.094713 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-182636c2-821f-4294-a8ee-eb529257b048 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:27.101973 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-182636c2-821f-4294-a8ee-eb529257b048 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:27.103296 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-182636c2-821f-4294-a8ee-eb529257b048 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:27.104532 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-182636c2-821f-4294-a8ee-eb529257b048 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:27.108958 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-182636c2-821f-4294-a8ee-eb529257b048 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:27.251208 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-182636c2-821f-4294-a8ee-eb529257b048 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:27.259387 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-182636c2-821f-4294-a8ee-eb529257b048 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1370 microversion: 2.1 time: 0.182480 Jun 22 09:01:27.259941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 308/563] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:27 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:28.281241 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-47d91f4b-4d71-402b-8caa-ab4344c32187 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:28.282803 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-47d91f4b-4d71-402b-8caa-ab4344c32187 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:28.290625 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell0:SELECT=6 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:28.292866 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-47d91f4b-4d71-402b-8caa-ab4344c32187 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:28.294217 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-47d91f4b-4d71-402b-8caa-ab4344c32187 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:28.295263 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-47d91f4b-4d71-402b-8caa-ab4344c32187 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:28.296307 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-47d91f4b-4d71-402b-8caa-ab4344c32187 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:28.474398 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-47d91f4b-4d71-402b-8caa-ab4344c32187 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:28.484121 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-47d91f4b-4d71-402b-8caa-ab4344c32187 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1370 microversion: 2.1 time: 0.207195 Jun 22 09:01:28.484694 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 256/564] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:28 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1370 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:29.504456 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-32981fb5-c4bc-4c14-81ac-c448a061749d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:29.505377 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-32981fb5-c4bc-4c14-81ac-c448a061749d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:29.507924 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell0:SELECT=2 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:29.509435 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell0:SELECT=6 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:29.517221 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-32981fb5-c4bc-4c14-81ac-c448a061749d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:29.517876 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-32981fb5-c4bc-4c14-81ac-c448a061749d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:29.518944 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-32981fb5-c4bc-4c14-81ac-c448a061749d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:29.520271 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-32981fb5-c4bc-4c14-81ac-c448a061749d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:29.526008 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=89 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:29.669542 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-32981fb5-c4bc-4c14-81ac-c448a061749d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:29.678023 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-32981fb5-c4bc-4c14-81ac-c448a061749d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1370 microversion: 2.1 time: 0.179938 Jun 22 09:01:29.679175 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 309/565] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:29 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:30.696599 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c176963d-6171-45bd-a0e5-5a404bb92bb8 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:30.697263 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c176963d-6171-45bd-a0e5-5a404bb92bb8 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:30.704731 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c176963d-6171-45bd-a0e5-5a404bb92bb8 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:30.705359 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c176963d-6171-45bd-a0e5-5a404bb92bb8 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:30.706442 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c176963d-6171-45bd-a0e5-5a404bb92bb8 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:30.706978 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c176963d-6171-45bd-a0e5-5a404bb92bb8 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:30.864765 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-c176963d-6171-45bd-a0e5-5a404bb92bb8 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:30.872402 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c176963d-6171-45bd-a0e5-5a404bb92bb8 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1370 microversion: 2.1 time: 0.180652 Jun 22 09:01:30.872989 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 257/566] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:30 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:31.890083 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-0dc24157-428e-4d23-a262-107165771f75 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:31.897587 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-0dc24157-428e-4d23-a262-107165771f75 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:31.897587 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0dc24157-428e-4d23-a262-107165771f75 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:31.897873 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0dc24157-428e-4d23-a262-107165771f75 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:31.898537 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0dc24157-428e-4d23-a262-107165771f75 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:31.898974 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0dc24157-428e-4d23-a262-107165771f75 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:32.025072 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-0dc24157-428e-4d23-a262-107165771f75 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:32.032482 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-0dc24157-428e-4d23-a262-107165771f75 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1370 microversion: 2.1 time: 0.146350 Jun 22 09:01:32.033074 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 310/567] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:31 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:33.049636 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-64b40a9c-b752-4876-8ad4-bd000c7bcb48 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:33.050268 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-64b40a9c-b752-4876-8ad4-bd000c7bcb48 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:33.057580 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-64b40a9c-b752-4876-8ad4-bd000c7bcb48 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:33.058022 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-64b40a9c-b752-4876-8ad4-bd000c7bcb48 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:33.058782 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-64b40a9c-b752-4876-8ad4-bd000c7bcb48 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:33.059214 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-64b40a9c-b752-4876-8ad4-bd000c7bcb48 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:33.189374 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-64b40a9c-b752-4876-8ad4-bd000c7bcb48 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:33.197435 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-64b40a9c-b752-4876-8ad4-bd000c7bcb48 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1370 microversion: 2.1 time: 0.151549 Jun 22 09:01:33.198016 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 258/568] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:33 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:33.261104 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:01:33.261948 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Wed Jun 22 09:01:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:01:34.214941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-b11b38a4-b7b7-4dba-b303-9530b0f52f13 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:34.215855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-b11b38a4-b7b7-4dba-b303-9530b0f52f13 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:34.224005 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b11b38a4-b7b7-4dba-b303-9530b0f52f13 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:34.224810 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b11b38a4-b7b7-4dba-b303-9530b0f52f13 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:34.225732 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b11b38a4-b7b7-4dba-b303-9530b0f52f13 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:34.226172 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b11b38a4-b7b7-4dba-b303-9530b0f52f13 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:34.382917 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-b11b38a4-b7b7-4dba-b303-9530b0f52f13 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:34.391040 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-b11b38a4-b7b7-4dba-b303-9530b0f52f13 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1370 microversion: 2.1 time: 0.180035 Jun 22 09:01:34.391561 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 311/569] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:34 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:35.409187 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-fd333aed-4156-42a5-9c51-ca1bb0d98777 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:35.409850 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-fd333aed-4156-42a5-9c51-ca1bb0d98777 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:35.417021 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fd333aed-4156-42a5-9c51-ca1bb0d98777 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:35.417604 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fd333aed-4156-42a5-9c51-ca1bb0d98777 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:35.418553 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fd333aed-4156-42a5-9c51-ca1bb0d98777 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:35.419136 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fd333aed-4156-42a5-9c51-ca1bb0d98777 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:35.574497 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-fd333aed-4156-42a5-9c51-ca1bb0d98777 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:35.582699 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-fd333aed-4156-42a5-9c51-ca1bb0d98777 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1370 microversion: 2.1 time: 0.177918 Jun 22 09:01:35.583726 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 259/570] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:35 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:36.599953 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-1dfb2eed-1e45-47a0-b074-1e87cbbee987 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:36.600633 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-1dfb2eed-1e45-47a0-b074-1e87cbbee987 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:36.606858 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1dfb2eed-1e45-47a0-b074-1e87cbbee987 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:36.607299 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1dfb2eed-1e45-47a0-b074-1e87cbbee987 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:36.608063 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1dfb2eed-1e45-47a0-b074-1e87cbbee987 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:36.608500 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1dfb2eed-1e45-47a0-b074-1e87cbbee987 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:36.741082 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-1dfb2eed-1e45-47a0-b074-1e87cbbee987 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:36.748558 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-1dfb2eed-1e45-47a0-b074-1e87cbbee987 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1370 microversion: 2.1 time: 0.152778 Jun 22 09:01:36.749858 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 312/571] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:36 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:37.765982 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-5b0a83fd-54ed-440d-8fe4-4dc9eb2aaa8b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:37.766596 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-5b0a83fd-54ed-440d-8fe4-4dc9eb2aaa8b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:37.773528 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5b0a83fd-54ed-440d-8fe4-4dc9eb2aaa8b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:37.773987 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5b0a83fd-54ed-440d-8fe4-4dc9eb2aaa8b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:37.774749 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5b0a83fd-54ed-440d-8fe4-4dc9eb2aaa8b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:37.775187 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5b0a83fd-54ed-440d-8fe4-4dc9eb2aaa8b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:37.908748 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-5b0a83fd-54ed-440d-8fe4-4dc9eb2aaa8b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:37.917363 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-5b0a83fd-54ed-440d-8fe4-4dc9eb2aaa8b tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1370 microversion: 2.1 time: 0.155400 Jun 22 09:01:37.917881 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 260/572] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:37 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:38.934445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-5a18f54e-528f-43de-a764-7bf5f13c97a4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:38.934995 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-5a18f54e-528f-43de-a764-7bf5f13c97a4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:38.936907 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:38.941670 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5a18f54e-528f-43de-a764-7bf5f13c97a4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:38.942630 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5a18f54e-528f-43de-a764-7bf5f13c97a4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:38.943496 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5a18f54e-528f-43de-a764-7bf5f13c97a4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:38.943953 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5a18f54e-528f-43de-a764-7bf5f13c97a4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:39.070412 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-5a18f54e-528f-43de-a764-7bf5f13c97a4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:39.077791 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-5a18f54e-528f-43de-a764-7bf5f13c97a4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1370 microversion: 2.1 time: 0.147291 Jun 22 09:01:39.078355 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 313/573] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:38 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:40.094145 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-42b9c11b-a867-4036-939b-694e335805fb tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:40.094758 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-42b9c11b-a867-4036-939b-694e335805fb tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:40.101384 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-42b9c11b-a867-4036-939b-694e335805fb tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:40.101828 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-42b9c11b-a867-4036-939b-694e335805fb tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:40.102593 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-42b9c11b-a867-4036-939b-694e335805fb tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:40.103025 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-42b9c11b-a867-4036-939b-694e335805fb tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:40.232405 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-42b9c11b-a867-4036-939b-694e335805fb tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:40.240658 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-42b9c11b-a867-4036-939b-694e335805fb tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1370 microversion: 2.1 time: 0.150328 Jun 22 09:01:40.241257 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 261/574] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:40 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:41.257572 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-477d7b47-7c76-4c75-a022-688270c1a1d9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:41.258213 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-477d7b47-7c76-4c75-a022-688270c1a1d9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:41.264405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-477d7b47-7c76-4c75-a022-688270c1a1d9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:41.264882 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-477d7b47-7c76-4c75-a022-688270c1a1d9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:41.265645 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-477d7b47-7c76-4c75-a022-688270c1a1d9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:41.266083 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-477d7b47-7c76-4c75-a022-688270c1a1d9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:41.390932 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-477d7b47-7c76-4c75-a022-688270c1a1d9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:41.398993 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-477d7b47-7c76-4c75-a022-688270c1a1d9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1370 microversion: 2.1 time: 0.145910 Jun 22 09:01:41.399544 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 314/575] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:41 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:42.416076 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-673c4817-834b-4fbc-89f3-0d7b0ef7bf5f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:42.416675 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-673c4817-834b-4fbc-89f3-0d7b0ef7bf5f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:42.423153 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-673c4817-834b-4fbc-89f3-0d7b0ef7bf5f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:42.423599 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-673c4817-834b-4fbc-89f3-0d7b0ef7bf5f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:42.424350 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-673c4817-834b-4fbc-89f3-0d7b0ef7bf5f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:42.424796 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-673c4817-834b-4fbc-89f3-0d7b0ef7bf5f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:42.562728 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-673c4817-834b-4fbc-89f3-0d7b0ef7bf5f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:42.571448 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-673c4817-834b-4fbc-89f3-0d7b0ef7bf5f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1370 microversion: 2.1 time: 0.159162 Jun 22 09:01:42.572041 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 262/576] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:42 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:43.588890 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-8dd8f131-9637-47cb-a0b4-912607883bf6 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:43.590227 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-8dd8f131-9637-47cb-a0b4-912607883bf6 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:43.596681 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8dd8f131-9637-47cb-a0b4-912607883bf6 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:43.597248 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8dd8f131-9637-47cb-a0b4-912607883bf6 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:43.598032 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8dd8f131-9637-47cb-a0b4-912607883bf6 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:43.598655 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8dd8f131-9637-47cb-a0b4-912607883bf6 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:43.727219 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-8dd8f131-9637-47cb-a0b4-912607883bf6 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:43.734751 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-8dd8f131-9637-47cb-a0b4-912607883bf6 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1370 microversion: 2.1 time: 0.150056 Jun 22 09:01:43.735304 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 315/577] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:43 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:01:44.751750 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ff3f5fa7-28b3-42f4-af10-795583c88d57 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:44.752551 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ff3f5fa7-28b3-42f4-af10-795583c88d57 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:44.759692 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ff3f5fa7-28b3-42f4-af10-795583c88d57 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:44.764321 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ff3f5fa7-28b3-42f4-af10-795583c88d57 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:44.764321 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ff3f5fa7-28b3-42f4-af10-795583c88d57 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:44.764321 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ff3f5fa7-28b3-42f4-af10-795583c88d57 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:44.901277 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ff3f5fa7-28b3-42f4-af10-795583c88d57 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:44.908750 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ff3f5fa7-28b3-42f4-af10-795583c88d57 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1370 microversion: 2.1 time: 0.160973 Jun 22 09:01:44.913870 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 263/578] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:44 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:45.926191 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d7093985-f1c7-47d0-9c93-4412ff5e45c6 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:45.927559 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-d7093985-f1c7-47d0-9c93-4412ff5e45c6 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:45.934737 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d7093985-f1c7-47d0-9c93-4412ff5e45c6 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:45.935204 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d7093985-f1c7-47d0-9c93-4412ff5e45c6 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:45.936039 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d7093985-f1c7-47d0-9c93-4412ff5e45c6 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:45.936483 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d7093985-f1c7-47d0-9c93-4412ff5e45c6 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:46.066302 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-d7093985-f1c7-47d0-9c93-4412ff5e45c6 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:46.073721 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d7093985-f1c7-47d0-9c93-4412ff5e45c6 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1370 microversion: 2.1 time: 0.151574 Jun 22 09:01:46.074277 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 316/579] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:45 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:47.092764 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-eb7dc246-626a-49dd-8f24-f272140a06e3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:47.093395 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-eb7dc246-626a-49dd-8f24-f272140a06e3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:47.100244 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-eb7dc246-626a-49dd-8f24-f272140a06e3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:47.100730 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-eb7dc246-626a-49dd-8f24-f272140a06e3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:47.101595 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-eb7dc246-626a-49dd-8f24-f272140a06e3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:47.102037 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-eb7dc246-626a-49dd-8f24-f272140a06e3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:47.277302 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-eb7dc246-626a-49dd-8f24-f272140a06e3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:47.284770 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-eb7dc246-626a-49dd-8f24-f272140a06e3 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1370 microversion: 2.1 time: 0.195889 Jun 22 09:01:47.294930 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 264/580] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:47 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1370 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:47.747409 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d26a787e-0c45-4ebb-ad86-3b7962f86bb7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:47.747906 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-d26a787e-0c45-4ebb-ad86-3b7962f86bb7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:47.761093 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d26a787e-0c45-4ebb-ad86-3b7962f86bb7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:47.761551 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d26a787e-0c45-4ebb-ad86-3b7962f86bb7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:47.765865 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d26a787e-0c45-4ebb-ad86-3b7962f86bb7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:47.765865 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d26a787e-0c45-4ebb-ad86-3b7962f86bb7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:47.896643 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.objects.instance [None req-d26a787e-0c45-4ebb-ad86-3b7962f86bb7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lazy-loading 'services' on Instance uuid f0c80904-64ab-4f87-98d3-89784b0b0f96 {{(pid=118025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:01:48.161149 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d26a787e-0c45-4ebb-ad86-3b7962f86bb7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96/os-volume_attachments/a3ed9a80-5f81-4c3b-9448-72043bf67404" status: 202 len: 0 microversion: 2.1 time: 0.417457 Jun 22 09:01:48.162173 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 317/581] 10.222.0.16 () {58 vars in 1415 bytes} [Wed Jun 22 09:01:47 2022] DELETE /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96/os-volume_attachments/a3ed9a80-5f81-4c3b-9448-72043bf67404 => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:01:48.302553 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-2a2cee59-2ae5-4a89-8768-6015c7ac9898 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:48.303247 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-2a2cee59-2ae5-4a89-8768-6015c7ac9898 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:48.306096 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=30 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:48.312583 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2a2cee59-2ae5-4a89-8768-6015c7ac9898 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:48.313201 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2a2cee59-2ae5-4a89-8768-6015c7ac9898 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:48.314072 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2a2cee59-2ae5-4a89-8768-6015c7ac9898 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:48.314607 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2a2cee59-2ae5-4a89-8768-6015c7ac9898 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:48.457816 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-2a2cee59-2ae5-4a89-8768-6015c7ac9898 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:48.467781 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-2a2cee59-2ae5-4a89-8768-6015c7ac9898 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1370 microversion: 2.1 time: 0.168178 Jun 22 09:01:48.467781 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 265/582] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:48 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:49.489484 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-010abdb2-0959-487b-8c9c-c7e3b5bb9004 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:49.490391 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-010abdb2-0959-487b-8c9c-c7e3b5bb9004 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:49.496739 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-010abdb2-0959-487b-8c9c-c7e3b5bb9004 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:49.497154 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-010abdb2-0959-487b-8c9c-c7e3b5bb9004 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:49.497918 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-010abdb2-0959-487b-8c9c-c7e3b5bb9004 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:49.498349 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-010abdb2-0959-487b-8c9c-c7e3b5bb9004 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:49.638322 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-010abdb2-0959-487b-8c9c-c7e3b5bb9004 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:49.645702 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-010abdb2-0959-487b-8c9c-c7e3b5bb9004 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1370 microversion: 2.1 time: 0.163830 Jun 22 09:01:49.656252 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 318/583] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:49 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:50.341073 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-06cd9ba9-1da8-4e33-b562-8554e34dd5ca tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:50.342077 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-06cd9ba9-1da8-4e33-b562-8554e34dd5ca tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:50.348771 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-06cd9ba9-1da8-4e33-b562-8554e34dd5ca tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:50.349980 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-06cd9ba9-1da8-4e33-b562-8554e34dd5ca tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:50.350751 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-06cd9ba9-1da8-4e33-b562-8554e34dd5ca tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:50.351184 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-06cd9ba9-1da8-4e33-b562-8554e34dd5ca tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:50.370051 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=84 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:50.382106 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-06cd9ba9-1da8-4e33-b562-8554e34dd5ca tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Going to try to terminate instance {{(pid=118024) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:01:50.664014 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-baa381e4-6744-4102-ab04-9edae57f00d5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:50.664616 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-baa381e4-6744-4102-ab04-9edae57f00d5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:50.670884 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-baa381e4-6744-4102-ab04-9edae57f00d5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:50.671247 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-baa381e4-6744-4102-ab04-9edae57f00d5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:50.672005 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-baa381e4-6744-4102-ab04-9edae57f00d5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:50.672441 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-baa381e4-6744-4102-ab04-9edae57f00d5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:50.721455 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-06cd9ba9-1da8-4e33-b562-8554e34dd5ca tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 204 len: 0 microversion: 2.1 time: 0.383746 Jun 22 09:01:50.722189 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 266/584] 10.222.0.16 () {58 vars in 1238 bytes} [Wed Jun 22 09:01:50 2022] DELETE /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:01:50.736907 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f2c49b8f-2fcf-4b9d-a047-eb425487059e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:50.737606 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f2c49b8f-2fcf-4b9d-a047-eb425487059e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:50.744124 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f2c49b8f-2fcf-4b9d-a047-eb425487059e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:50.744578 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f2c49b8f-2fcf-4b9d-a047-eb425487059e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:50.745388 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f2c49b8f-2fcf-4b9d-a047-eb425487059e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:50.745825 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f2c49b8f-2fcf-4b9d-a047-eb425487059e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:50.832868 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-baa381e4-6744-4102-ab04-9edae57f00d5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:50.841064 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-baa381e4-6744-4102-ab04-9edae57f00d5 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1370 microversion: 2.1 time: 0.181520 Jun 22 09:01:50.841604 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 319/585] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:50 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:01:50.892533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-f2c49b8f-2fcf-4b9d-a047-eb425487059e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:50.900792 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f2c49b8f-2fcf-4b9d-a047-eb425487059e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1513 microversion: 2.1 time: 0.167991 Jun 22 09:01:50.901370 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 267/586] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:50 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:01:51.858585 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-6dc6068e-497a-4a43-af48-c267502532b9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:51.859196 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-6dc6068e-497a-4a43-af48-c267502532b9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:51.865353 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6dc6068e-497a-4a43-af48-c267502532b9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:51.865803 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6dc6068e-497a-4a43-af48-c267502532b9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:51.868330 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6dc6068e-497a-4a43-af48-c267502532b9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:51.868330 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6dc6068e-497a-4a43-af48-c267502532b9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:51.918307 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b4023561-85ad-4c98-8aad-f4ff89232d47 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:51.918936 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-b4023561-85ad-4c98-8aad-f4ff89232d47 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:51.925393 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b4023561-85ad-4c98-8aad-f4ff89232d47 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:51.925838 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b4023561-85ad-4c98-8aad-f4ff89232d47 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:51.926599 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b4023561-85ad-4c98-8aad-f4ff89232d47 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:51.927028 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b4023561-85ad-4c98-8aad-f4ff89232d47 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:52.038914 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-6dc6068e-497a-4a43-af48-c267502532b9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:52.046874 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-6dc6068e-497a-4a43-af48-c267502532b9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1370 microversion: 2.1 time: 0.192147 Jun 22 09:01:52.047439 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 320/587] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:51 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1370 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:52.083724 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-b4023561-85ad-4c98-8aad-f4ff89232d47 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:52.091823 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-b4023561-85ad-4c98-8aad-f4ff89232d47 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1513 microversion: 2.1 time: 0.177378 Jun 22 09:01:52.092396 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 268/588] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:51 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1513 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:52.247048 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-2afa771d-9175-431c-89b8-9a4f505d82bd req-d08a450d-0a77-4d69-b103-5c7a85088857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcbd1c7d-a978-447a-bf3e-bc4e579e0e45", "name": "network-vif-plugged", "status": "completed", "tag": "f2c5416a-4e17-4d7a-8b60-2e6a9f411ddd"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:01:52.255141 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-2afa771d-9175-431c-89b8-9a4f505d82bd req-d08a450d-0a77-4d69-b103-5c7a85088857 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:52.255590 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-2afa771d-9175-431c-89b8-9a4f505d82bd req-d08a450d-0a77-4d69-b103-5c7a85088857 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:52.267279 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-2afa771d-9175-431c-89b8-9a4f505d82bd req-d08a450d-0a77-4d69-b103-5c7a85088857 service nova] Creating event network-vif-plugged:f2c5416a-4e17-4d7a-8b60-2e6a9f411ddd for instance bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 on hv-cinder-84599 Jun 22 09:01:52.272141 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-2afa771d-9175-431c-89b8-9a4f505d82bd req-d08a450d-0a77-4d69-b103-5c7a85088857 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028804 Jun 22 09:01:52.272720 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 321/589] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:01:53.064468 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6d92f66b-d615-451b-a249-cc17b95d8480 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:53.065142 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-6d92f66b-d615-451b-a249-cc17b95d8480 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:53.071689 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6d92f66b-d615-451b-a249-cc17b95d8480 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:53.072137 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6d92f66b-d615-451b-a249-cc17b95d8480 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:53.072931 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6d92f66b-d615-451b-a249-cc17b95d8480 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:53.073371 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6d92f66b-d615-451b-a249-cc17b95d8480 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:53.109322 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-fcc7f674-6612-4d21-91ee-c477c3ccd850 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:53.110104 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-fcc7f674-6612-4d21-91ee-c477c3ccd850 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:53.116935 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fcc7f674-6612-4d21-91ee-c477c3ccd850 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:53.117501 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fcc7f674-6612-4d21-91ee-c477c3ccd850 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:53.118351 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fcc7f674-6612-4d21-91ee-c477c3ccd850 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:53.118864 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fcc7f674-6612-4d21-91ee-c477c3ccd850 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:53.260525 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-6d92f66b-d615-451b-a249-cc17b95d8480 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:53.268183 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-6d92f66b-d615-451b-a249-cc17b95d8480 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1370 microversion: 2.1 time: 0.207601 Jun 22 09:01:53.268749 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 269/590] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:53 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1370 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:53.287143 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-fcc7f674-6612-4d21-91ee-c477c3ccd850 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:53.295401 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-fcc7f674-6612-4d21-91ee-c477c3ccd850 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1513 microversion: 2.1 time: 0.190290 Jun 22 09:01:53.295963 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 322/591] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:53 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1513 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:01:54.285779 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-e6a74f8f-1099-474e-bffe-c102dd14003c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:54.286386 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-e6a74f8f-1099-474e-bffe-c102dd14003c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:54.293579 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e6a74f8f-1099-474e-bffe-c102dd14003c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:54.294032 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e6a74f8f-1099-474e-bffe-c102dd14003c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:54.294784 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e6a74f8f-1099-474e-bffe-c102dd14003c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:54.295221 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e6a74f8f-1099-474e-bffe-c102dd14003c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:54.313200 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-200a62b2-9434-4221-94ae-ab5bfd7cb21c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:54.313912 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-200a62b2-9434-4221-94ae-ab5bfd7cb21c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:54.319874 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-200a62b2-9434-4221-94ae-ab5bfd7cb21c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:54.320414 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-200a62b2-9434-4221-94ae-ab5bfd7cb21c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:54.321206 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-200a62b2-9434-4221-94ae-ab5bfd7cb21c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:54.321643 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-200a62b2-9434-4221-94ae-ab5bfd7cb21c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:54.479313 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-e6a74f8f-1099-474e-bffe-c102dd14003c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:54.486939 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-e6a74f8f-1099-474e-bffe-c102dd14003c tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1370 microversion: 2.1 time: 0.204944 Jun 22 09:01:54.487491 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 270/592] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:54 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1370 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:54.501878 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-200a62b2-9434-4221-94ae-ab5bfd7cb21c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:54.510135 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-200a62b2-9434-4221-94ae-ab5bfd7cb21c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1513 microversion: 2.1 time: 0.200825 Jun 22 09:01:54.510693 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 323/593] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:54 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1513 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:01:55.195467 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [req-0683b249-dcd3-4365-9edc-c138fe06acba req-2e7a45e7-6b5a-48d1-b840-40a7fc44675f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c80904-64ab-4f87-98d3-89784b0b0f96", "name": "network-vif-deleted", "tag": "a3085c34-2f17-4743-8ee5-dda470978f80"}]} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:01:55.204618 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-0683b249-dcd3-4365-9edc-c138fe06acba req-2e7a45e7-6b5a-48d1-b840-40a7fc44675f service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:55.209550 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-0683b249-dcd3-4365-9edc-c138fe06acba req-2e7a45e7-6b5a-48d1-b840-40a7fc44675f service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:55.216588 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.compute.server_external_events [req-0683b249-dcd3-4365-9edc-c138fe06acba req-2e7a45e7-6b5a-48d1-b840-40a7fc44675f service nova] Creating event network-vif-deleted:a3085c34-2f17-4743-8ee5-dda470978f80 for instance f0c80904-64ab-4f87-98d3-89784b0b0f96 on hv-cinder-84599 Jun 22 09:01:55.221364 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [req-0683b249-dcd3-4365-9edc-c138fe06acba req-2e7a45e7-6b5a-48d1-b840-40a7fc44675f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031508 Jun 22 09:01:55.221935 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 271/594] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:01:55.503949 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-582258a8-34fc-4a28-bc10-55f2d1c51b83 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:55.504564 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-582258a8-34fc-4a28-bc10-55f2d1c51b83 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:55.511303 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-582258a8-34fc-4a28-bc10-55f2d1c51b83 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:55.511749 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-582258a8-34fc-4a28-bc10-55f2d1c51b83 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:55.512505 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-582258a8-34fc-4a28-bc10-55f2d1c51b83 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:55.513009 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-582258a8-34fc-4a28-bc10-55f2d1c51b83 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:55.528933 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-4d4f10b8-d375-48b5-aac1-2c7407a858c7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:55.530214 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-4d4f10b8-d375-48b5-aac1-2c7407a858c7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:55.536174 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4d4f10b8-d375-48b5-aac1-2c7407a858c7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:55.536753 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4d4f10b8-d375-48b5-aac1-2c7407a858c7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:55.537676 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4d4f10b8-d375-48b5-aac1-2c7407a858c7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:55.538273 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4d4f10b8-d375-48b5-aac1-2c7407a858c7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:55.612271 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-4d4f10b8-d375-48b5-aac1-2c7407a858c7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:55.620157 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-4d4f10b8-d375-48b5-aac1-2c7407a858c7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1471 microversion: 2.1 time: 0.096042 Jun 22 09:01:55.620723 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 272/595] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:55 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1471 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:01:55.671112 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-582258a8-34fc-4a28-bc10-55f2d1c51b83 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:55.679029 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-582258a8-34fc-4a28-bc10-55f2d1c51b83 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1564 microversion: 2.1 time: 0.178669 Jun 22 09:01:55.679792 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 324/596] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:55 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1564 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:55.696437 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-bfb94da9-f51c-4dca-b42d-57401c22f6f9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:55.697062 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-bfb94da9-f51c-4dca-b42d-57401c22f6f9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:55.703958 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bfb94da9-f51c-4dca-b42d-57401c22f6f9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:55.704409 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bfb94da9-f51c-4dca-b42d-57401c22f6f9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:55.705205 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bfb94da9-f51c-4dca-b42d-57401c22f6f9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:55.705642 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bfb94da9-f51c-4dca-b42d-57401c22f6f9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:55.784304 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-bfb94da9-f51c-4dca-b42d-57401c22f6f9 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092534 Jun 22 09:01:55.784987 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 273/597] 10.222.0.16 () {58 vars in 1274 bytes} [Wed Jun 22 09:01:55 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:01:56.637252 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-dd544889-a7b5-47a3-97bc-e779175da9f8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:56.645809 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-dd544889-a7b5-47a3-97bc-e779175da9f8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:56.645809 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dd544889-a7b5-47a3-97bc-e779175da9f8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:56.645809 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dd544889-a7b5-47a3-97bc-e779175da9f8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:56.647665 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dd544889-a7b5-47a3-97bc-e779175da9f8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:56.648632 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dd544889-a7b5-47a3-97bc-e779175da9f8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:56.682389 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dd544889-a7b5-47a3-97bc-e779175da9f8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:56.682656 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dd544889-a7b5-47a3-97bc-e779175da9f8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:56.683192 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.objects.instance [None req-dd544889-a7b5-47a3-97bc-e779175da9f8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lazy-loading 'fault' on Instance uuid f0c80904-64ab-4f87-98d3-89784b0b0f96 {{(pid=118025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:01:56.686314 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:56.763732 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-dd544889-a7b5-47a3-97bc-e779175da9f8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:56.771202 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-dd544889-a7b5-47a3-97bc-e779175da9f8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 200 len: 1309 microversion: 2.1 time: 0.138577 Jun 22 09:01:56.771700 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 325/598] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:56 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 1309 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:57.069365 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [req-9fb03de2-9066-4ef1-a8d7-afacf350f2b3 req-a9868be7-cc9c-4def-95d5-d8596ae0c217 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcbd1c7d-a978-447a-bf3e-bc4e579e0e45", "tag": "f2c5416a-4e17-4d7a-8b60-2e6a9f411ddd"}]} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:01:57.078725 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-9fb03de2-9066-4ef1-a8d7-afacf350f2b3 req-a9868be7-cc9c-4def-95d5-d8596ae0c217 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:57.079452 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-9fb03de2-9066-4ef1-a8d7-afacf350f2b3 req-a9868be7-cc9c-4def-95d5-d8596ae0c217 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:57.091641 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.compute.server_external_events [req-9fb03de2-9066-4ef1-a8d7-afacf350f2b3 req-a9868be7-cc9c-4def-95d5-d8596ae0c217 service nova] Creating event network-changed:f2c5416a-4e17-4d7a-8b60-2e6a9f411ddd for instance bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 on hv-cinder-84599 Jun 22 09:01:57.097106 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [req-9fb03de2-9066-4ef1-a8d7-afacf350f2b3 req-a9868be7-cc9c-4def-95d5-d8596ae0c217 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033135 Jun 22 09:01:57.098134 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 274/599] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:01:57.793287 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9a15172d-d7af-4663-9d90-d7d7abceb22c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:57.795007 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9a15172d-d7af-4663-9d90-d7d7abceb22c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: f0c80904-64ab-4f87-98d3-89784b0b0f96] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:57.801151 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9a15172d-d7af-4663-9d90-d7d7abceb22c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:57.802168 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9a15172d-d7af-4663-9d90-d7d7abceb22c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:57.803277 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9a15172d-d7af-4663-9d90-d7d7abceb22c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:57.804970 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9a15172d-d7af-4663-9d90-d7d7abceb22c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:57.824810 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.wsgi [None req-9a15172d-d7af-4663-9d90-d7d7abceb22c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] HTTP exception thrown: Instance f0c80904-64ab-4f87-98d3-89784b0b0f96 could not be found. Jun 22 09:01:57.827989 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9a15172d-d7af-4663-9d90-d7d7abceb22c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Request method failure captured: Jun 22 09:01:57.827989 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: request: GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 HTTP/1.1 Jun 22 09:01:57.827989 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept: application/json Jun 22 09:01:57.827989 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept-Encoding: identity Jun 22 09:01:57.827989 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Connection: close Jun 22 09:01:57.827989 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Length: 0 Jun 22 09:01:57.827989 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Type: application/json Jun 22 09:01:57.827989 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Host: 10.222.0.16 Jun 22 09:01:57.827989 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Openstack-System-Scope: None Jun 22 09:01:57.827989 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: User-Agent: python-urllib3/1.26.9 Jun 22 09:01:57.827989 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Auth-Token: gAAAAABistnwW58eg0H5izXqOYS8prbTryzv-qY6QMKHpgVx0Arx0yKPLqyxm2MBr09aNk9-2SsakokrD_VEj6ksNow37ZW6te0_pq9jCbY-1fD3c5x6hu9o_YmM2KntsAiaQeHK9j8hpU2GMGoJTAd9EvztrWl7EkATU2bbaMYRoV3dbnUWxD0 Jun 22 09:01:57.827989 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Id: None Jun 22 09:01:57.827989 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Name: None Jun 22 09:01:57.827989 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Identity-Status: Confirmed Jun 22 09:01:57.827989 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Is-Admin-Project: True Jun 22 09:01:57.827989 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Id: default Jun 22 09:01:57.827989 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Name: Default Jun 22 09:01:57.827989 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Id: 8ce1a6d223c14059b3ea7e07bfa1f577 Jun 22 09:01:57.827989 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1169723824 Jun 22 09:01:57.827989 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Role: member,reader Jun 22 09:01:57.827989 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Roles: member,reader Jun 22 09:01:57.829549 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8ce1a6d223c14059b3ea7e07bfa1f577"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8ce1a6d223c14059b3ea7e07bfa1f577"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8ce1a6d223c14059b3ea7e07bfa1f577"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8ce1a6d223c14059b3ea7e07bfa1f577", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:01:57.829549 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant: tempest-VolumesSnapshotTestJSON-1169723824 Jun 22 09:01:57.829549 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Id: 8ce1a6d223c14059b3ea7e07bfa1f577 Jun 22 09:01:57.829549 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1169723824 Jun 22 09:01:57.829549 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User: tempest-VolumesSnapshotTestJSON-1169723824-project Jun 22 09:01:57.829549 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Id: default Jun 22 09:01:57.829549 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Name: Default Jun 22 09:01:57.829549 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Id: 6fb1f75729d741928453fea5345938a2 Jun 22 09:01:57.829549 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Name: tempest-VolumesSnapshotTestJSON-1169723824-project Jun 22 09:01:57.829549 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: method: > Jun 22 09:01:57.829549 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: exception: Instance f0c80904-64ab-4f87-98d3-89784b0b0f96 could not be found. Jun 22 09:01:57.829549 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: action_args: {'id': 'f0c80904-64ab-4f87-98d3-89784b0b0f96'} Jun 22 09:01:57.830331 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:01:57.830331 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:01:57.830331 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:01:57.830331 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:01:57.830331 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:01:57.830331 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:01:57.830331 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:01:57.830331 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:01:57.830331 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:01:57.830331 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:01:57.830331 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0c80904-64ab-4f87-98d3-89784b0b0f96 could not be found. Jun 22 09:01:57.830331 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:01:57.830331 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:01:57.830331 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:01:57.830331 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:01:57.830331 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:01:57.830331 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:01:57.830331 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:01:57.830331 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:01:57.830331 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:01:57.831709 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:01:57.831709 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:01:57.831709 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:01:57.831709 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:01:57.831709 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:01:57.831709 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:01:57.831709 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:01:57.831709 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0c80904-64ab-4f87-98d3-89784b0b0f96 could not be found. Jun 22 09:01:57.831709 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:01:57.831709 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:01:57.831709 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:01:57.831709 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:01:57.831709 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:01:57.831709 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:01:57.831709 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:01:57.831709 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:01:57.831709 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0c80904-64ab-4f87-98d3-89784b0b0f96 could not be found. Jun 22 09:01:57.831709 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:01:57.833147 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9a15172d-d7af-4663-9d90-d7d7abceb22c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Returning 404 to user: Instance f0c80904-64ab-4f87-98d3-89784b0b0f96 could not be found. {{(pid=118025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:01:57.833147 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9a15172d-d7af-4663-9d90-d7d7abceb22c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96" status: 404 len: 111 microversion: 2.1 time: 0.043484 Jun 22 09:01:57.833147 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 326/600] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:57 2022] GET /compute/v2.1/servers/f0c80904-64ab-4f87-98d3-89784b0b0f96 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:02:12.444762 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-243cb1c6-0a1c-4ac7-8059-ca5e5015cda8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1651076503", "imageRef": "c24d36a8-7909-4174-9b12-42c8d76647ac", "flavorRef": "452", "networks": [{"uuid": "9cebc870-2569-4829-b107-df670b5ca5e5"}]}} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:02:12.453431 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:12.454154 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:12.519622 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.network.neutron [None req-243cb1c6-0a1c-4ac7-8059-ca5e5015cda8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] validate_networks() for [('9cebc870-2569-4829-b107-df670b5ca5e5', None, None, None, None, None)] {{(pid=118024) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:02:12.949435 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-243cb1c6-0a1c-4ac7-8059-ca5e5015cda8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Flavor limits 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:02:12.952194 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-243cb1c6-0a1c-4ac7-8059-ca5e5015cda8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Image limits 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:02:12.952194 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-243cb1c6-0a1c-4ac7-8059-ca5e5015cda8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Flavor pref 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:02:12.952194 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-243cb1c6-0a1c-4ac7-8059-ca5e5015cda8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Image pref 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:02:12.952194 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-243cb1c6-0a1c-4ac7-8059-ca5e5015cda8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:02:12.960816 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-243cb1c6-0a1c-4ac7-8059-ca5e5015cda8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:12.961953 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-243cb1c6-0a1c-4ac7-8059-ca5e5015cda8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:12.963007 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-243cb1c6-0a1c-4ac7-8059-ca5e5015cda8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:12.963731 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-243cb1c6-0a1c-4ac7-8059-ca5e5015cda8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:12.982243 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.quota [None req-243cb1c6-0a1c-4ac7-8059-ca5e5015cda8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Getting quotas for project 8ce1a6d223c14059b3ea7e07bfa1f577. Resources: {'cores', 'instances', 'ram'} {{(pid=118024) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:02:12.986325 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.quota [None req-243cb1c6-0a1c-4ac7-8059-ca5e5015cda8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Getting quotas for user 6fb1f75729d741928453fea5345938a2 and project 8ce1a6d223c14059b3ea7e07bfa1f577. Resources: {'cores', 'instances', 'ram'} {{(pid=118024) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:02:12.997519 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-243cb1c6-0a1c-4ac7-8059-ca5e5015cda8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Going to run 1 instances... {{(pid=118024) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:02:12.999967 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-243cb1c6-0a1c-4ac7-8059-ca5e5015cda8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c24d36a8-7909-4174-9b12-42c8d76647ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118024) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:02:13.185814 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-243cb1c6-0a1c-4ac7-8059-ca5e5015cda8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.745414 Jun 22 09:02:13.188134 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 275/601] 10.222.0.16 () {60 vars in 1146 bytes} [Wed Jun 22 09:02:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 09:02:13.199136 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d08bb8c9-9d06-4f55-8bd8-7edace7eba4a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:13.200064 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-d08bb8c9-9d06-4f55-8bd8-7edace7eba4a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:13.202712 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=29 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:13.207581 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=5 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:13.305027 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-d08bb8c9-9d06-4f55-8bd8-7edace7eba4a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:13.313348 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d08bb8c9-9d06-4f55-8bd8-7edace7eba4a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1219 microversion: 2.1 time: 0.119717 Jun 22 09:02:13.314221 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 327/602] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:13 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1219 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:14.331457 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-686b8035-a2f0-42d6-abaa-4010501f3593 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:14.332075 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-686b8035-a2f0-42d6-abaa-4010501f3593 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:14.339881 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-686b8035-a2f0-42d6-abaa-4010501f3593 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:14.349436 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-686b8035-a2f0-42d6-abaa-4010501f3593 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:14.350366 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-686b8035-a2f0-42d6-abaa-4010501f3593 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:14.350826 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-686b8035-a2f0-42d6-abaa-4010501f3593 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:14.418233 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-686b8035-a2f0-42d6-abaa-4010501f3593 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:14.426585 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-686b8035-a2f0-42d6-abaa-4010501f3593 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1223 microversion: 2.1 time: 0.098975 Jun 22 09:02:14.427207 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 276/603] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:14 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1223 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:15.445499 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2079ef44-7e3a-4571-9604-2a8379997fdf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:15.449825 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2079ef44-7e3a-4571-9604-2a8379997fdf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:15.453956 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2079ef44-7e3a-4571-9604-2a8379997fdf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:15.454407 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2079ef44-7e3a-4571-9604-2a8379997fdf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:15.455171 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2079ef44-7e3a-4571-9604-2a8379997fdf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:15.455610 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2079ef44-7e3a-4571-9604-2a8379997fdf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:15.519041 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-2079ef44-7e3a-4571-9604-2a8379997fdf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:15.527446 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2079ef44-7e3a-4571-9604-2a8379997fdf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1271 microversion: 2.1 time: 0.086411 Jun 22 09:02:15.528008 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 328/604] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:15 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:16.544969 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6e780471-1d44-462d-b724-4e816ec288e0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:16.545517 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-6e780471-1d44-462d-b724-4e816ec288e0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:16.557490 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6e780471-1d44-462d-b724-4e816ec288e0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:16.558348 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6e780471-1d44-462d-b724-4e816ec288e0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:16.559364 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6e780471-1d44-462d-b724-4e816ec288e0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:16.560151 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6e780471-1d44-462d-b724-4e816ec288e0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:16.634627 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-6e780471-1d44-462d-b724-4e816ec288e0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:16.642594 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-6e780471-1d44-462d-b724-4e816ec288e0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1277 microversion: 2.1 time: 0.101558 Jun 22 09:02:16.643459 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 277/605] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:16 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1277 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:17.664987 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c1e6bef9-cccd-4c36-a675-aca026571553 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:17.666302 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c1e6bef9-cccd-4c36-a675-aca026571553 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:17.682517 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c1e6bef9-cccd-4c36-a675-aca026571553 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:17.683234 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c1e6bef9-cccd-4c36-a675-aca026571553 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:17.684236 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c1e6bef9-cccd-4c36-a675-aca026571553 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:17.685491 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c1e6bef9-cccd-4c36-a675-aca026571553 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:18.136070 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c1e6bef9-cccd-4c36-a675-aca026571553 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:18.151292 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c1e6bef9-cccd-4c36-a675-aca026571553 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1319 microversion: 2.1 time: 0.490090 Jun 22 09:02:18.153975 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 329/606] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:17 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1319 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:18.803009 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [req-2070af1b-eefd-4a30-904e-13a4e363576f req-e95de335-8749-451f-80ee-032d0b40a117 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb580ec8-80e7-4908-8761-08e8b136be42", "tag": "9ad2e9b8-6709-4bf7-b051-613d55daa2f8"}]} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:02:18.818243 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-2070af1b-eefd-4a30-904e-13a4e363576f req-e95de335-8749-451f-80ee-032d0b40a117 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:18.818834 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-2070af1b-eefd-4a30-904e-13a4e363576f req-e95de335-8749-451f-80ee-032d0b40a117 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:18.847648 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.compute.server_external_events [req-2070af1b-eefd-4a30-904e-13a4e363576f req-e95de335-8749-451f-80ee-032d0b40a117 service nova] Creating event network-changed:9ad2e9b8-6709-4bf7-b051-613d55daa2f8 for instance fb580ec8-80e7-4908-8761-08e8b136be42 on hv-cinder-84599 Jun 22 09:02:18.858958 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [req-2070af1b-eefd-4a30-904e-13a4e363576f req-e95de335-8749-451f-80ee-032d0b40a117 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059547 Jun 22 09:02:18.865608 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 278/607] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:02:19.182662 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-64c03d58-895c-401c-a6ed-6ee4f1479881 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:19.189262 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-64c03d58-895c-401c-a6ed-6ee4f1479881 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:19.201597 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-64c03d58-895c-401c-a6ed-6ee4f1479881 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:19.210137 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-64c03d58-895c-401c-a6ed-6ee4f1479881 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:19.211309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-64c03d58-895c-401c-a6ed-6ee4f1479881 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:19.213034 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-64c03d58-895c-401c-a6ed-6ee4f1479881 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:19.601616 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-64c03d58-895c-401c-a6ed-6ee4f1479881 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:19.618453 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-64c03d58-895c-401c-a6ed-6ee4f1479881 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1319 microversion: 2.1 time: 0.450199 Jun 22 09:02:19.623788 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 330/608] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:19 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1319 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:20.641683 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-9638041b-0abe-45fa-a2f1-4c837e48cfda tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:20.642551 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-9638041b-0abe-45fa-a2f1-4c837e48cfda tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:20.650069 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9638041b-0abe-45fa-a2f1-4c837e48cfda tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:20.650695 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9638041b-0abe-45fa-a2f1-4c837e48cfda tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:20.651581 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9638041b-0abe-45fa-a2f1-4c837e48cfda tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:20.652119 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9638041b-0abe-45fa-a2f1-4c837e48cfda tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:20.834462 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-9638041b-0abe-45fa-a2f1-4c837e48cfda tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:20.842800 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-9638041b-0abe-45fa-a2f1-4c837e48cfda tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1319 microversion: 2.1 time: 0.206245 Jun 22 09:02:20.843378 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 279/609] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:20 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:21.862344 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d29b2b06-a659-4aaf-88e4-4412b8c92b7a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:21.863235 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-d29b2b06-a659-4aaf-88e4-4412b8c92b7a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:21.870026 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d29b2b06-a659-4aaf-88e4-4412b8c92b7a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:21.874757 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d29b2b06-a659-4aaf-88e4-4412b8c92b7a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:21.874757 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d29b2b06-a659-4aaf-88e4-4412b8c92b7a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:21.874757 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d29b2b06-a659-4aaf-88e4-4412b8c92b7a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:22.325506 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-d29b2b06-a659-4aaf-88e4-4412b8c92b7a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:22.333479 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d29b2b06-a659-4aaf-88e4-4412b8c92b7a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1319 microversion: 2.1 time: 0.475005 Jun 22 09:02:22.334252 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 331/610] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:21 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1319 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:22.609269 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-7a7b7da0-2ebe-4cd5-9348-a3c602713f55 tempest-TestVolumeBootPattern-1963305283 tempest-TestVolumeBootPattern-1963305283-project] Action: 'create', calling method: .version_select at 0x7f5756b4ff70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-868085579", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVJ35vSW2oBcuPfNYrMQ2Yr0Ejj3qyTHYG4yYNWhaKV/zb+V+uRzUrad0qFpAhVNjazZyjA0Sm+pg79WFyJewdhJZX8H5l4zCJMUND78HKlWPyTSJz8Eh67mNu5m5/eVA=="}} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:02:22.624896 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.quota [None req-7a7b7da0-2ebe-4cd5-9348-a3c602713f55 tempest-TestVolumeBootPattern-1963305283 tempest-TestVolumeBootPattern-1963305283-project] Getting quotas for project 5d266a03480b441dbcc3dbcf7471b906. Resources: {'key_pairs'} {{(pid=118024) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:02:22.628671 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.quota [None req-7a7b7da0-2ebe-4cd5-9348-a3c602713f55 tempest-TestVolumeBootPattern-1963305283 tempest-TestVolumeBootPattern-1963305283-project] Getting quotas for user 5eb444cf685b4c31b4524737a62a7530 and project 5d266a03480b441dbcc3dbcf7471b906. Resources: {'key_pairs'} {{(pid=118024) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:02:22.720016 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-7a7b7da0-2ebe-4cd5-9348-a3c602713f55 tempest-TestVolumeBootPattern-1963305283 tempest-TestVolumeBootPattern-1963305283-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.317243 Jun 22 09:02:22.721000 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 280/611] 10.222.0.16 () {60 vars in 1158 bytes} [Wed Jun 22 09:02:22 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:02:23.350932 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-224a6cdd-e937-4e27-a548-4d7601b3db79 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:23.351547 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-224a6cdd-e937-4e27-a548-4d7601b3db79 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:23.354326 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell0:SELECT=2 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:23.359438 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-224a6cdd-e937-4e27-a548-4d7601b3db79 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:23.359888 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-224a6cdd-e937-4e27-a548-4d7601b3db79 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:23.360686 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-224a6cdd-e937-4e27-a548-4d7601b3db79 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:23.361151 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-224a6cdd-e937-4e27-a548-4d7601b3db79 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:23.551342 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-224a6cdd-e937-4e27-a548-4d7601b3db79 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:23.559450 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-224a6cdd-e937-4e27-a548-4d7601b3db79 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1319 microversion: 2.1 time: 0.212398 Jun 22 09:02:23.560048 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 332/612] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:23 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:24.572678 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell0:SELECT=2 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:24.577519 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-8b910a27-2f77-40fa-a070-55c069a92b29 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:24.578232 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-8b910a27-2f77-40fa-a070-55c069a92b29 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:24.585640 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8b910a27-2f77-40fa-a070-55c069a92b29 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:24.587607 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8b910a27-2f77-40fa-a070-55c069a92b29 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:24.590567 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8b910a27-2f77-40fa-a070-55c069a92b29 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:24.590567 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8b910a27-2f77-40fa-a070-55c069a92b29 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:24.727731 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-8b910a27-2f77-40fa-a070-55c069a92b29 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:24.735698 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-8b910a27-2f77-40fa-a070-55c069a92b29 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1319 microversion: 2.1 time: 0.163975 Jun 22 09:02:24.736594 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 281/613] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:24 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:25.752541 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-b213e59f-05da-4a64-9b46-9158ef421e66 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:25.753891 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-b213e59f-05da-4a64-9b46-9158ef421e66 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:25.760609 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b213e59f-05da-4a64-9b46-9158ef421e66 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:25.761490 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b213e59f-05da-4a64-9b46-9158ef421e66 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:25.762321 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b213e59f-05da-4a64-9b46-9158ef421e66 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:25.762823 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b213e59f-05da-4a64-9b46-9158ef421e66 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:25.901199 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-b213e59f-05da-4a64-9b46-9158ef421e66 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:25.909275 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-b213e59f-05da-4a64-9b46-9158ef421e66 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1319 microversion: 2.1 time: 0.160891 Jun 22 09:02:25.909851 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 333/614] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:25 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:26.935707 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-adc9c3e3-4e99-47d2-b107-e7476b307246 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:26.935707 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-adc9c3e3-4e99-47d2-b107-e7476b307246 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:26.935707 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-adc9c3e3-4e99-47d2-b107-e7476b307246 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:26.935707 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-adc9c3e3-4e99-47d2-b107-e7476b307246 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:26.936853 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-adc9c3e3-4e99-47d2-b107-e7476b307246 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:26.936853 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-adc9c3e3-4e99-47d2-b107-e7476b307246 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:27.114914 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-adc9c3e3-4e99-47d2-b107-e7476b307246 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:27.123259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-adc9c3e3-4e99-47d2-b107-e7476b307246 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1319 microversion: 2.1 time: 0.200558 Jun 22 09:02:27.130083 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 282/615] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:26 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:27.550957 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-9f6b85ab-f841-488e-9466-123675198b4c req-ac9a16fd-7dfa-41b9-963a-d5c6ef3b2630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb580ec8-80e7-4908-8761-08e8b136be42", "name": "network-vif-plugged", "status": "completed", "tag": "9ad2e9b8-6709-4bf7-b051-613d55daa2f8"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:02:27.560012 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-9f6b85ab-f841-488e-9466-123675198b4c req-ac9a16fd-7dfa-41b9-963a-d5c6ef3b2630 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:27.562175 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-9f6b85ab-f841-488e-9466-123675198b4c req-ac9a16fd-7dfa-41b9-963a-d5c6ef3b2630 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:27.573071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-9f6b85ab-f841-488e-9466-123675198b4c req-ac9a16fd-7dfa-41b9-963a-d5c6ef3b2630 service nova] Creating event network-vif-plugged:9ad2e9b8-6709-4bf7-b051-613d55daa2f8 for instance fb580ec8-80e7-4908-8761-08e8b136be42 on hv-cinder-84599 Jun 22 09:02:27.578246 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-9f6b85ab-f841-488e-9466-123675198b4c req-ac9a16fd-7dfa-41b9-963a-d5c6ef3b2630 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031348 Jun 22 09:02:27.579003 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 334/616] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:02:28.146446 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ee795ca9-18ce-4a5d-987d-5b4594644dad tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:28.147560 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ee795ca9-18ce-4a5d-987d-5b4594644dad tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:28.157299 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ee795ca9-18ce-4a5d-987d-5b4594644dad tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:28.158013 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ee795ca9-18ce-4a5d-987d-5b4594644dad tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:28.161791 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ee795ca9-18ce-4a5d-987d-5b4594644dad tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:28.161791 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ee795ca9-18ce-4a5d-987d-5b4594644dad tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:28.296416 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ee795ca9-18ce-4a5d-987d-5b4594644dad tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:28.304250 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ee795ca9-18ce-4a5d-987d-5b4594644dad tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1319 microversion: 2.1 time: 0.164293 Jun 22 09:02:28.304835 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 283/617] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:28 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:29.322372 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-deada6b4-6b76-4516-beed-c53112be938e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:29.323769 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-deada6b4-6b76-4516-beed-c53112be938e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:29.330237 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-deada6b4-6b76-4516-beed-c53112be938e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:29.330699 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-deada6b4-6b76-4516-beed-c53112be938e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:29.331478 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-deada6b4-6b76-4516-beed-c53112be938e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:29.331918 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-deada6b4-6b76-4516-beed-c53112be938e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:29.468209 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-deada6b4-6b76-4516-beed-c53112be938e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:29.475602 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-deada6b4-6b76-4516-beed-c53112be938e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1319 microversion: 2.1 time: 0.157681 Jun 22 09:02:29.476157 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 335/618] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:29 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:30.492657 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-694fdd54-613d-41e6-81c3-b130a95c3d95 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:30.493317 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-694fdd54-613d-41e6-81c3-b130a95c3d95 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:30.500383 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-694fdd54-613d-41e6-81c3-b130a95c3d95 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:30.500866 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-694fdd54-613d-41e6-81c3-b130a95c3d95 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:30.501628 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-694fdd54-613d-41e6-81c3-b130a95c3d95 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:30.502065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-694fdd54-613d-41e6-81c3-b130a95c3d95 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:30.634880 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-694fdd54-613d-41e6-81c3-b130a95c3d95 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:30.642257 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-694fdd54-613d-41e6-81c3-b130a95c3d95 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1319 microversion: 2.1 time: 0.153524 Jun 22 09:02:30.642823 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 284/619] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:30 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:31.659226 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-17548922-3185-450f-9a28-def6f51e3303 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:31.659839 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-17548922-3185-450f-9a28-def6f51e3303 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:31.665852 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-17548922-3185-450f-9a28-def6f51e3303 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:31.666302 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-17548922-3185-450f-9a28-def6f51e3303 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:31.667571 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-17548922-3185-450f-9a28-def6f51e3303 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:31.668010 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-17548922-3185-450f-9a28-def6f51e3303 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:31.794154 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-17548922-3185-450f-9a28-def6f51e3303 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:31.801574 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-17548922-3185-450f-9a28-def6f51e3303 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1319 microversion: 2.1 time: 0.146165 Jun 22 09:02:31.802139 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 336/620] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:31 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:32.818774 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-28b72729-e30a-4fd6-9506-ce90a9372739 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:32.819387 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-28b72729-e30a-4fd6-9506-ce90a9372739 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:32.821759 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell0:SELECT=10 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:32.826647 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-28b72729-e30a-4fd6-9506-ce90a9372739 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:32.827093 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-28b72729-e30a-4fd6-9506-ce90a9372739 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:32.827849 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-28b72729-e30a-4fd6-9506-ce90a9372739 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:32.828287 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-28b72729-e30a-4fd6-9506-ce90a9372739 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:32.955928 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-28b72729-e30a-4fd6-9506-ce90a9372739 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:32.963821 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-28b72729-e30a-4fd6-9506-ce90a9372739 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1319 microversion: 2.1 time: 0.148431 Jun 22 09:02:32.964413 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 285/621] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:32 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:33.981173 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-8852f3b9-617a-44a2-8dac-cb9bed6e6caf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:33.983720 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-8852f3b9-617a-44a2-8dac-cb9bed6e6caf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:33.987828 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8852f3b9-617a-44a2-8dac-cb9bed6e6caf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:33.988273 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8852f3b9-617a-44a2-8dac-cb9bed6e6caf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:33.989057 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8852f3b9-617a-44a2-8dac-cb9bed6e6caf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:33.989496 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8852f3b9-617a-44a2-8dac-cb9bed6e6caf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:34.123116 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-8852f3b9-617a-44a2-8dac-cb9bed6e6caf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:34.130711 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-8852f3b9-617a-44a2-8dac-cb9bed6e6caf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1319 microversion: 2.1 time: 0.153956 Jun 22 09:02:34.131268 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 337/622] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:33 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:35.147330 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-980c9f8f-9af4-4be5-ae23-54563bfb10bd tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:35.147941 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-980c9f8f-9af4-4be5-ae23-54563bfb10bd tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:35.155076 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-980c9f8f-9af4-4be5-ae23-54563bfb10bd tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:35.155525 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-980c9f8f-9af4-4be5-ae23-54563bfb10bd tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:35.156282 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-980c9f8f-9af4-4be5-ae23-54563bfb10bd tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:35.156722 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-980c9f8f-9af4-4be5-ae23-54563bfb10bd tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:35.283947 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-980c9f8f-9af4-4be5-ae23-54563bfb10bd tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:35.291378 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-980c9f8f-9af4-4be5-ae23-54563bfb10bd tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1319 microversion: 2.1 time: 0.147883 Jun 22 09:02:35.292490 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 286/623] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:35 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:35.453212 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-916895d0-7ed9-42e8-b23f-72d461bfbe35 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:35.453736 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-916895d0-7ed9-42e8-b23f-72d461bfbe35 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:35.459679 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-916895d0-7ed9-42e8-b23f-72d461bfbe35 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:35.460118 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-916895d0-7ed9-42e8-b23f-72d461bfbe35 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:35.460897 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-916895d0-7ed9-42e8-b23f-72d461bfbe35 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:35.461335 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-916895d0-7ed9-42e8-b23f-72d461bfbe35 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:35.484041 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-916895d0-7ed9-42e8-b23f-72d461bfbe35 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/ips" status: 200 len: 145 microversion: 2.1 time: 0.034698 Jun 22 09:02:35.484584 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 338/624] 10.222.0.16 () {58 vars in 1247 bytes} [Wed Jun 22 09:02:35 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/ips => generated 145 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:02:36.309942 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-89f5192a-9b78-443e-873b-da04403ea4bc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:36.310551 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-89f5192a-9b78-443e-873b-da04403ea4bc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:36.316990 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-89f5192a-9b78-443e-873b-da04403ea4bc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:36.317436 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-89f5192a-9b78-443e-873b-da04403ea4bc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:36.318194 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-89f5192a-9b78-443e-873b-da04403ea4bc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:36.318668 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-89f5192a-9b78-443e-873b-da04403ea4bc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:36.450537 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-89f5192a-9b78-443e-873b-da04403ea4bc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:36.458628 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-89f5192a-9b78-443e-873b-da04403ea4bc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1319 microversion: 2.1 time: 0.153378 Jun 22 09:02:36.462783 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 287/625] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:36 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:37.477721 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-94ef85cb-9946-42b8-9331-59677d7294f1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:37.478243 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-94ef85cb-9946-42b8-9331-59677d7294f1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:37.484317 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-94ef85cb-9946-42b8-9331-59677d7294f1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:37.484760 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-94ef85cb-9946-42b8-9331-59677d7294f1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:37.485536 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-94ef85cb-9946-42b8-9331-59677d7294f1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:37.485970 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-94ef85cb-9946-42b8-9331-59677d7294f1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:37.616354 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-94ef85cb-9946-42b8-9331-59677d7294f1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:37.624188 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-94ef85cb-9946-42b8-9331-59677d7294f1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1319 microversion: 2.1 time: 0.150378 Jun 22 09:02:37.624740 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 339/626] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:37 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:38.641613 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c930e66b-e3a8-4a81-9698-f22cd619dfd7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:38.642193 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c930e66b-e3a8-4a81-9698-f22cd619dfd7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:38.648445 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c930e66b-e3a8-4a81-9698-f22cd619dfd7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:38.648925 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c930e66b-e3a8-4a81-9698-f22cd619dfd7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:38.649682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c930e66b-e3a8-4a81-9698-f22cd619dfd7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:38.650121 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c930e66b-e3a8-4a81-9698-f22cd619dfd7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:38.780958 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-c930e66b-e3a8-4a81-9698-f22cd619dfd7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:38.788192 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c930e66b-e3a8-4a81-9698-f22cd619dfd7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1319 microversion: 2.1 time: 0.150562 Jun 22 09:02:38.788754 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 288/627] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:38 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:39.804969 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-bfcface1-b74e-418c-b75b-d2579aaf58ae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:39.805587 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-bfcface1-b74e-418c-b75b-d2579aaf58ae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:39.812944 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bfcface1-b74e-418c-b75b-d2579aaf58ae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:39.813454 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bfcface1-b74e-418c-b75b-d2579aaf58ae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:39.814444 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bfcface1-b74e-418c-b75b-d2579aaf58ae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:39.814963 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bfcface1-b74e-418c-b75b-d2579aaf58ae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:39.952423 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-bfcface1-b74e-418c-b75b-d2579aaf58ae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:39.961085 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-bfcface1-b74e-418c-b75b-d2579aaf58ae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1507 microversion: 2.1 time: 0.160208 Jun 22 09:02:39.961854 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 340/628] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:39 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:39.979191 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6b583c44-9bda-4ae8-9768-dc8a8e1427a6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5cfcf7e9-9b1b-4820-ac90-6656e4805006", "device": "/dev/sdb"}} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:02:39.980893 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-6b583c44-9bda-4ae8-9768-dc8a8e1427a6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:39.987846 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6b583c44-9bda-4ae8-9768-dc8a8e1427a6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:39.988297 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6b583c44-9bda-4ae8-9768-dc8a8e1427a6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:39.989109 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6b583c44-9bda-4ae8-9768-dc8a8e1427a6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:39.989624 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6b583c44-9bda-4ae8-9768-dc8a8e1427a6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:40.748077 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-6b583c44-9bda-4ae8-9768-dc8a8e1427a6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "POST /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.773117 Jun 22 09:02:40.748682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 289/629] 10.222.0.16 () {60 vars in 1322 bytes} [Wed Jun 22 09:02:39 2022] POST /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42/os-volume_attachments => generated 194 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:02:41.060310 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-011cc76b-09c5-4446-a4b1-670e9860aeb5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0cf66cd-eddb-4d10-8f47-1a33a5d8e11a"}} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:02:41.061503 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-011cc76b-09c5-4446-a4b1-670e9860aeb5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:41.067692 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-011cc76b-09c5-4446-a4b1-670e9860aeb5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:41.068138 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-011cc76b-09c5-4446-a4b1-670e9860aeb5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:41.069025 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-011cc76b-09c5-4446-a4b1-670e9860aeb5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:41.069468 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-011cc76b-09c5-4446-a4b1-670e9860aeb5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:48.750402 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=79 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:49.379903 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-011cc76b-09c5-4446-a4b1-670e9860aeb5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "POST /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.323671 Jun 22 09:02:49.380510 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 341/630] 10.222.0.16 () {60 vars in 1322 bytes} [Wed Jun 22 09:02:41 2022] POST /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 194 bytes in 8325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:03:12.922000 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=4 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:12.922806 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:12.927005 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-60ea731f-4a4c-4315-ba2b-545a95172d30 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:03:12.928308 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-60ea731f-4a4c-4315-ba2b-545a95172d30 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:12.934577 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-60ea731f-4a4c-4315-ba2b-545a95172d30 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:12.935861 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-60ea731f-4a4c-4315-ba2b-545a95172d30 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:12.935861 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-60ea731f-4a4c-4315-ba2b-545a95172d30 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:12.936175 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-60ea731f-4a4c-4315-ba2b-545a95172d30 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:18.865255 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=32 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:18.866143 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=4,nova_cell1:INSERT=1 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:18.870395 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-927378a0-78ea-4712-b0e8-c5d654e7f0c4 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:18.878561 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-927378a0-78ea-4712-b0e8-c5d654e7f0c4 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:18.878720 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-927378a0-78ea-4712-b0e8-c5d654e7f0c4 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:18.879094 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-927378a0-78ea-4712-b0e8-c5d654e7f0c4 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:18.879849 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-927378a0-78ea-4712-b0e8-c5d654e7f0c4 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:18.880280 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-927378a0-78ea-4712-b0e8-c5d654e7f0c4 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:18.904273 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-927378a0-78ea-4712-b0e8-c5d654e7f0c4 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10/ips" status: 200 len: 150 microversion: 2.1 time: 0.040423 Jun 22 09:03:18.904851 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 342/631] 10.222.0.16 () {58 vars in 1247 bytes} [Wed Jun 22 09:03:18 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:03:19.145574 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:03:19.145793 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Wed Jun 22 09:03:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:03:23.024307 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=2 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:23.094337 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=4 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:57.690186 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-60ea731f-4a4c-4315-ba2b-545a95172d30 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "POST /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363/action" status: 200 len: 38320 microversion: 2.20 time: 44.768695 Jun 22 09:03:57.691308 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 290/632] 10.222.0.16 () {62 vars in 1318 bytes} [Wed Jun 22 09:03:12 2022] POST /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363/action => generated 38320 bytes in 44771 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:03:57.863922 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=2 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:58.025040 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-230e77c3-2cf8-4802-8425-ba780fdee82f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:58.025540 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-230e77c3-2cf8-4802-8425-ba780fdee82f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:58.031439 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-230e77c3-2cf8-4802-8425-ba780fdee82f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:58.031889 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-230e77c3-2cf8-4802-8425-ba780fdee82f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:58.033166 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-230e77c3-2cf8-4802-8425-ba780fdee82f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:58.033611 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-230e77c3-2cf8-4802-8425-ba780fdee82f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:58.056304 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-230e77c3-2cf8-4802-8425-ba780fdee82f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363/ips" status: 200 len: 150 microversion: 2.20 time: 0.198139 Jun 22 09:03:58.056861 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 343/633] 10.222.0.16 () {60 vars in 1288 bytes} [Wed Jun 22 09:03:57 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363/ips => generated 150 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 09:04:00.349588 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-90a95e9c-81fe-47d7-89c5-90cde2430c9b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:04:00.357740 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-90a95e9c-81fe-47d7-89c5-90cde2430c9b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:00.358248 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-90a95e9c-81fe-47d7-89c5-90cde2430c9b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:00.419536 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-90a95e9c-81fe-47d7-89c5-90cde2430c9b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Going to try to stop instance {{(pid=118024) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 22 09:04:00.598384 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-90a95e9c-81fe-47d7-89c5-90cde2430c9b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "POST /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/action" status: 202 len: 0 microversion: 2.1 time: 0.253443 Jun 22 09:04:00.598974 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 291/634] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jun 22 09:04:00 2022] POST /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:04:00.607086 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d20fe0db-e2f9-4711-8126-02178d9ecbdc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:00.607696 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-d20fe0db-e2f9-4711-8126-02178d9ecbdc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:00.614799 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d20fe0db-e2f9-4711-8126-02178d9ecbdc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:00.615501 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d20fe0db-e2f9-4711-8126-02178d9ecbdc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:00.616313 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d20fe0db-e2f9-4711-8126-02178d9ecbdc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:00.616759 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d20fe0db-e2f9-4711-8126-02178d9ecbdc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:00.803720 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-d20fe0db-e2f9-4711-8126-02178d9ecbdc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:00.811687 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d20fe0db-e2f9-4711-8126-02178d9ecbdc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1724 microversion: 2.1 time: 0.208518 Jun 22 09:04:00.812243 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 344/635] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:00 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:01.830992 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-14b2f188-38e5-4724-b21e-9f87d2afa0a2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:01.831691 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-14b2f188-38e5-4724-b21e-9f87d2afa0a2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:01.839046 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-14b2f188-38e5-4724-b21e-9f87d2afa0a2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:01.839507 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-14b2f188-38e5-4724-b21e-9f87d2afa0a2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:01.840270 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-14b2f188-38e5-4724-b21e-9f87d2afa0a2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:01.840735 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-14b2f188-38e5-4724-b21e-9f87d2afa0a2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:02.031960 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-14b2f188-38e5-4724-b21e-9f87d2afa0a2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:02.039939 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-14b2f188-38e5-4724-b21e-9f87d2afa0a2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1724 microversion: 2.1 time: 0.213797 Jun 22 09:04:02.040498 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 292/636] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:01 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:03.058392 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-00acea86-2499-46c2-87c0-c881254cda89 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:03.059005 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-00acea86-2499-46c2-87c0-c881254cda89 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:03.066379 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-00acea86-2499-46c2-87c0-c881254cda89 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:03.066828 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-00acea86-2499-46c2-87c0-c881254cda89 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:03.067588 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-00acea86-2499-46c2-87c0-c881254cda89 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:03.068022 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-00acea86-2499-46c2-87c0-c881254cda89 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:03.194586 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-00acea86-2499-46c2-87c0-c881254cda89 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:03.202666 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-00acea86-2499-46c2-87c0-c881254cda89 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1724 microversion: 2.1 time: 0.148072 Jun 22 09:04:03.203232 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 345/637] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:03 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:04.221109 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-bf4eefbd-c7d0-49c1-b662-9da1f2e9ff1a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:04.221718 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-bf4eefbd-c7d0-49c1-b662-9da1f2e9ff1a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:04.228374 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bf4eefbd-c7d0-49c1-b662-9da1f2e9ff1a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:04.228857 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bf4eefbd-c7d0-49c1-b662-9da1f2e9ff1a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:04.229629 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bf4eefbd-c7d0-49c1-b662-9da1f2e9ff1a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:04.230062 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bf4eefbd-c7d0-49c1-b662-9da1f2e9ff1a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:04.359159 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-bf4eefbd-c7d0-49c1-b662-9da1f2e9ff1a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:04.367089 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-bf4eefbd-c7d0-49c1-b662-9da1f2e9ff1a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1724 microversion: 2.1 time: 0.150538 Jun 22 09:04:04.367645 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 293/638] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:04 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:05.383961 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-ee0d23ec-2742-4ad2-90bf-a751462be70f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:05.384572 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-ee0d23ec-2742-4ad2-90bf-a751462be70f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:05.391161 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ee0d23ec-2742-4ad2-90bf-a751462be70f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:05.392277 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ee0d23ec-2742-4ad2-90bf-a751462be70f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:05.393155 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ee0d23ec-2742-4ad2-90bf-a751462be70f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:05.393593 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ee0d23ec-2742-4ad2-90bf-a751462be70f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:05.517998 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-ee0d23ec-2742-4ad2-90bf-a751462be70f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:05.525917 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-ee0d23ec-2742-4ad2-90bf-a751462be70f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1724 microversion: 2.1 time: 0.145733 Jun 22 09:04:05.526629 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 346/639] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:05 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:06.543219 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c41c83df-48b3-4631-bff9-ee87fa81c1a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:06.543834 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c41c83df-48b3-4631-bff9-ee87fa81c1a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:06.550892 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c41c83df-48b3-4631-bff9-ee87fa81c1a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:06.551597 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c41c83df-48b3-4631-bff9-ee87fa81c1a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:06.552358 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c41c83df-48b3-4631-bff9-ee87fa81c1a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:06.552846 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c41c83df-48b3-4631-bff9-ee87fa81c1a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:06.682053 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-c41c83df-48b3-4631-bff9-ee87fa81c1a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:06.690853 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c41c83df-48b3-4631-bff9-ee87fa81c1a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1724 microversion: 2.1 time: 0.151455 Jun 22 09:04:06.691422 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 294/640] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:06 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:07.708402 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e3714f91-6be8-4ba7-b72f-49107854a93b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:07.708960 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e3714f91-6be8-4ba7-b72f-49107854a93b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:07.715432 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e3714f91-6be8-4ba7-b72f-49107854a93b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:07.715893 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e3714f91-6be8-4ba7-b72f-49107854a93b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:07.716647 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e3714f91-6be8-4ba7-b72f-49107854a93b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:07.717119 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e3714f91-6be8-4ba7-b72f-49107854a93b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:07.846466 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-e3714f91-6be8-4ba7-b72f-49107854a93b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:07.854405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e3714f91-6be8-4ba7-b72f-49107854a93b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1724 microversion: 2.1 time: 0.150601 Jun 22 09:04:07.854975 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 347/641] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:07 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:08.871567 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-877de10b-4fc4-4f79-97b6-aa32821195bc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:08.872182 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-877de10b-4fc4-4f79-97b6-aa32821195bc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:08.879600 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-877de10b-4fc4-4f79-97b6-aa32821195bc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:08.880104 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-877de10b-4fc4-4f79-97b6-aa32821195bc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:08.880899 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-877de10b-4fc4-4f79-97b6-aa32821195bc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:08.881342 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-877de10b-4fc4-4f79-97b6-aa32821195bc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:09.011270 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-877de10b-4fc4-4f79-97b6-aa32821195bc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:09.019468 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-877de10b-4fc4-4f79-97b6-aa32821195bc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1724 microversion: 2.1 time: 0.151906 Jun 22 09:04:09.020034 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 295/642] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:08 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:10.035967 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e5db209e-10ff-4618-a40b-be76cbb98611 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:10.036586 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e5db209e-10ff-4618-a40b-be76cbb98611 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:10.043367 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e5db209e-10ff-4618-a40b-be76cbb98611 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:10.043915 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e5db209e-10ff-4618-a40b-be76cbb98611 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:10.044762 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e5db209e-10ff-4618-a40b-be76cbb98611 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:10.045297 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e5db209e-10ff-4618-a40b-be76cbb98611 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:10.181826 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-e5db209e-10ff-4618-a40b-be76cbb98611 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:10.189536 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e5db209e-10ff-4618-a40b-be76cbb98611 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1724 microversion: 2.1 time: 0.157495 Jun 22 09:04:10.190100 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 348/643] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:10 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:04:11.207279 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-49f95e50-2074-4c86-b58e-9697ed61381a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:11.207944 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-49f95e50-2074-4c86-b58e-9697ed61381a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:11.214709 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-49f95e50-2074-4c86-b58e-9697ed61381a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:11.215584 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-49f95e50-2074-4c86-b58e-9697ed61381a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:11.215913 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-49f95e50-2074-4c86-b58e-9697ed61381a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:11.216351 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-49f95e50-2074-4c86-b58e-9697ed61381a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:11.342995 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-49f95e50-2074-4c86-b58e-9697ed61381a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:11.351032 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-49f95e50-2074-4c86-b58e-9697ed61381a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1724 microversion: 2.1 time: 0.148292 Jun 22 09:04:11.351670 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 296/644] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:11 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:12.367549 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-cdadecb3-a607-47d8-9ea4-1d17f1c78667 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:12.368179 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-cdadecb3-a607-47d8-9ea4-1d17f1c78667 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:12.374185 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cdadecb3-a607-47d8-9ea4-1d17f1c78667 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:12.374629 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cdadecb3-a607-47d8-9ea4-1d17f1c78667 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:12.375373 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cdadecb3-a607-47d8-9ea4-1d17f1c78667 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:12.375806 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cdadecb3-a607-47d8-9ea4-1d17f1c78667 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:12.518604 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-cdadecb3-a607-47d8-9ea4-1d17f1c78667 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:12.527550 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-cdadecb3-a607-47d8-9ea4-1d17f1c78667 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1724 microversion: 2.1 time: 0.164004 Jun 22 09:04:12.528109 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 349/645] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:12 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:04:13.545324 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-694d10d4-596b-4242-8b95-01e142c50e65 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:13.545935 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-694d10d4-596b-4242-8b95-01e142c50e65 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:13.553382 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-694d10d4-596b-4242-8b95-01e142c50e65 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:13.553840 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-694d10d4-596b-4242-8b95-01e142c50e65 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:13.554682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-694d10d4-596b-4242-8b95-01e142c50e65 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:13.555033 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-694d10d4-596b-4242-8b95-01e142c50e65 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:13.684594 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-694d10d4-596b-4242-8b95-01e142c50e65 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:13.693183 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-694d10d4-596b-4242-8b95-01e142c50e65 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1724 microversion: 2.1 time: 0.151681 Jun 22 09:04:13.693751 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 297/646] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:13 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:14.710408 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-6ab303fa-5c53-4bf7-8260-af2397d5295e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:14.710938 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-6ab303fa-5c53-4bf7-8260-af2397d5295e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:14.717429 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6ab303fa-5c53-4bf7-8260-af2397d5295e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:14.717880 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6ab303fa-5c53-4bf7-8260-af2397d5295e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:14.718640 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6ab303fa-5c53-4bf7-8260-af2397d5295e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:14.719080 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6ab303fa-5c53-4bf7-8260-af2397d5295e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:14.844421 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-6ab303fa-5c53-4bf7-8260-af2397d5295e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:14.852455 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-6ab303fa-5c53-4bf7-8260-af2397d5295e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1724 microversion: 2.1 time: 0.146087 Jun 22 09:04:14.853046 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 350/647] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:14 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:15.870042 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3c92bff8-73c0-420c-ba0a-89cc211e0dc5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:15.870651 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3c92bff8-73c0-420c-ba0a-89cc211e0dc5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:15.877411 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3c92bff8-73c0-420c-ba0a-89cc211e0dc5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:15.877855 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3c92bff8-73c0-420c-ba0a-89cc211e0dc5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:15.878620 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3c92bff8-73c0-420c-ba0a-89cc211e0dc5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:15.879572 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3c92bff8-73c0-420c-ba0a-89cc211e0dc5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:16.010241 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3c92bff8-73c0-420c-ba0a-89cc211e0dc5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:16.018628 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3c92bff8-73c0-420c-ba0a-89cc211e0dc5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1724 microversion: 2.1 time: 0.152577 Jun 22 09:04:16.019183 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 298/648] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:15 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:04:17.035454 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-da870f33-3a37-48c6-bf53-0d203afd17fb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:17.036061 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-da870f33-3a37-48c6-bf53-0d203afd17fb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:17.043373 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-da870f33-3a37-48c6-bf53-0d203afd17fb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:17.043816 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-da870f33-3a37-48c6-bf53-0d203afd17fb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:17.044570 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-da870f33-3a37-48c6-bf53-0d203afd17fb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:17.045030 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-da870f33-3a37-48c6-bf53-0d203afd17fb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:17.169531 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-da870f33-3a37-48c6-bf53-0d203afd17fb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:17.177963 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-da870f33-3a37-48c6-bf53-0d203afd17fb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1724 microversion: 2.1 time: 0.146284 Jun 22 09:04:17.181661 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 351/649] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:17 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:18.195347 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ccf3154a-d869-4828-a17a-36994c35c6ba tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:18.195958 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ccf3154a-d869-4828-a17a-36994c35c6ba tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:18.202633 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ccf3154a-d869-4828-a17a-36994c35c6ba tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:18.203077 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ccf3154a-d869-4828-a17a-36994c35c6ba tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:18.203840 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ccf3154a-d869-4828-a17a-36994c35c6ba tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:18.204269 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ccf3154a-d869-4828-a17a-36994c35c6ba tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:18.339048 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ccf3154a-d869-4828-a17a-36994c35c6ba tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:18.347865 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ccf3154a-d869-4828-a17a-36994c35c6ba tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1724 microversion: 2.1 time: 0.156459 Jun 22 09:04:18.348427 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 299/650] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:18 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:19.369481 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2d338f6d-9c4e-482d-bbf6-41e9fa2d11ed tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:19.370095 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2d338f6d-9c4e-482d-bbf6-41e9fa2d11ed tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:19.376864 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2d338f6d-9c4e-482d-bbf6-41e9fa2d11ed tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:19.377317 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2d338f6d-9c4e-482d-bbf6-41e9fa2d11ed tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:19.378081 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2d338f6d-9c4e-482d-bbf6-41e9fa2d11ed tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:19.378520 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2d338f6d-9c4e-482d-bbf6-41e9fa2d11ed tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:19.510669 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-2d338f6d-9c4e-482d-bbf6-41e9fa2d11ed tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:19.518801 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2d338f6d-9c4e-482d-bbf6-41e9fa2d11ed tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1724 microversion: 2.1 time: 0.153794 Jun 22 09:04:19.519355 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 352/651] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:19 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:20.535271 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6567cb13-e89f-421e-acb3-8337be781db0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:20.540648 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-6567cb13-e89f-421e-acb3-8337be781db0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:20.543116 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6567cb13-e89f-421e-acb3-8337be781db0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:20.543560 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6567cb13-e89f-421e-acb3-8337be781db0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:20.544313 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6567cb13-e89f-421e-acb3-8337be781db0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:20.544986 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6567cb13-e89f-421e-acb3-8337be781db0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:20.673776 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-6567cb13-e89f-421e-acb3-8337be781db0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:20.682188 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-6567cb13-e89f-421e-acb3-8337be781db0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1724 microversion: 2.1 time: 0.150719 Jun 22 09:04:20.682742 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 300/652] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:20 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:21.699907 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-61642344-f940-4147-b2f8-ca4e58d152ad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:21.700517 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-61642344-f940-4147-b2f8-ca4e58d152ad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:21.707060 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-61642344-f940-4147-b2f8-ca4e58d152ad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:21.707504 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-61642344-f940-4147-b2f8-ca4e58d152ad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:21.708257 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-61642344-f940-4147-b2f8-ca4e58d152ad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:21.709367 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-61642344-f940-4147-b2f8-ca4e58d152ad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:21.838350 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-61642344-f940-4147-b2f8-ca4e58d152ad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:21.846211 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-61642344-f940-4147-b2f8-ca4e58d152ad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1724 microversion: 2.1 time: 0.150150 Jun 22 09:04:21.846764 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 353/653] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:21 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:04:22.864175 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ece259fc-b21e-4bb2-90d5-e2944033575a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:22.865711 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ece259fc-b21e-4bb2-90d5-e2944033575a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:22.872278 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ece259fc-b21e-4bb2-90d5-e2944033575a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:22.872731 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ece259fc-b21e-4bb2-90d5-e2944033575a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:22.873602 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ece259fc-b21e-4bb2-90d5-e2944033575a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:22.874042 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ece259fc-b21e-4bb2-90d5-e2944033575a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:23.003713 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ece259fc-b21e-4bb2-90d5-e2944033575a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:23.012886 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ece259fc-b21e-4bb2-90d5-e2944033575a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1724 microversion: 2.1 time: 0.152528 Jun 22 09:04:23.013532 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 301/654] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:22 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:24.031233 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e28c87e0-166a-4ade-83be-be3e857f7f3b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:24.031844 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e28c87e0-166a-4ade-83be-be3e857f7f3b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:24.038941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e28c87e0-166a-4ade-83be-be3e857f7f3b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:24.039391 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e28c87e0-166a-4ade-83be-be3e857f7f3b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:24.040154 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e28c87e0-166a-4ade-83be-be3e857f7f3b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:24.040589 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e28c87e0-166a-4ade-83be-be3e857f7f3b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:24.170480 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-e28c87e0-166a-4ade-83be-be3e857f7f3b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:24.178735 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e28c87e0-166a-4ade-83be-be3e857f7f3b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1724 microversion: 2.1 time: 0.151377 Jun 22 09:04:24.179292 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 354/655] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:24 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:25.196473 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ccfca7b6-de2c-44f0-9816-8b134df67988 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:25.197208 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ccfca7b6-de2c-44f0-9816-8b134df67988 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:25.199626 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=23 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:04:25.204469 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ccfca7b6-de2c-44f0-9816-8b134df67988 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:25.211477 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ccfca7b6-de2c-44f0-9816-8b134df67988 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:25.211477 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ccfca7b6-de2c-44f0-9816-8b134df67988 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:25.211477 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ccfca7b6-de2c-44f0-9816-8b134df67988 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:25.211477 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:04:25.336610 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ccfca7b6-de2c-44f0-9816-8b134df67988 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:25.344558 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ccfca7b6-de2c-44f0-9816-8b134df67988 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1724 microversion: 2.1 time: 0.151990 Jun 22 09:04:25.345156 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 302/656] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:25 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:26.364495 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f43a2bba-3227-4517-aeb1-8512c0b67a2d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:26.365772 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-f43a2bba-3227-4517-aeb1-8512c0b67a2d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:26.372178 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f43a2bba-3227-4517-aeb1-8512c0b67a2d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:26.372628 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f43a2bba-3227-4517-aeb1-8512c0b67a2d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:26.373429 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f43a2bba-3227-4517-aeb1-8512c0b67a2d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:26.373872 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f43a2bba-3227-4517-aeb1-8512c0b67a2d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:26.505563 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-f43a2bba-3227-4517-aeb1-8512c0b67a2d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:26.513637 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f43a2bba-3227-4517-aeb1-8512c0b67a2d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1724 microversion: 2.1 time: 0.153081 Jun 22 09:04:26.514192 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 355/657] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:26 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:27.531173 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-730b0ded-ff07-438c-814e-7024fdda54c3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:27.531794 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-730b0ded-ff07-438c-814e-7024fdda54c3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:27.538569 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-730b0ded-ff07-438c-814e-7024fdda54c3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:27.539016 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-730b0ded-ff07-438c-814e-7024fdda54c3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:27.539770 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-730b0ded-ff07-438c-814e-7024fdda54c3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:27.540206 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-730b0ded-ff07-438c-814e-7024fdda54c3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:27.669022 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-730b0ded-ff07-438c-814e-7024fdda54c3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:27.678579 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-730b0ded-ff07-438c-814e-7024fdda54c3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1724 microversion: 2.1 time: 0.151013 Jun 22 09:04:27.682746 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 303/658] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:27 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:28.698251 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-5902f8a3-1daf-46de-bd49-76347301a842 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:28.698853 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-5902f8a3-1daf-46de-bd49-76347301a842 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:28.701285 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=27 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:04:28.705937 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5902f8a3-1daf-46de-bd49-76347301a842 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:28.706425 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5902f8a3-1daf-46de-bd49-76347301a842 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:28.707178 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5902f8a3-1daf-46de-bd49-76347301a842 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:28.707610 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5902f8a3-1daf-46de-bd49-76347301a842 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:28.711626 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=81 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:04:28.836861 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-5902f8a3-1daf-46de-bd49-76347301a842 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:28.844941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-5902f8a3-1daf-46de-bd49-76347301a842 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1724 microversion: 2.1 time: 0.150425 Jun 22 09:04:28.845485 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 356/659] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:28 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:29.862176 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-9793fafc-9034-4d8c-bcd7-57bc1fd396f9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:29.862815 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-9793fafc-9034-4d8c-bcd7-57bc1fd396f9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:29.870065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9793fafc-9034-4d8c-bcd7-57bc1fd396f9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:29.870513 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9793fafc-9034-4d8c-bcd7-57bc1fd396f9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:29.871274 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9793fafc-9034-4d8c-bcd7-57bc1fd396f9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:29.871713 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9793fafc-9034-4d8c-bcd7-57bc1fd396f9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:30.003757 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-9793fafc-9034-4d8c-bcd7-57bc1fd396f9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:30.011960 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-9793fafc-9034-4d8c-bcd7-57bc1fd396f9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1724 microversion: 2.1 time: 0.153620 Jun 22 09:04:30.012519 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 304/660] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:29 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:31.028944 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f92d06f3-62d2-45c0-8dd6-db1063bba0ee tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:31.029562 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-f92d06f3-62d2-45c0-8dd6-db1063bba0ee tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:31.036043 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f92d06f3-62d2-45c0-8dd6-db1063bba0ee tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:31.036520 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f92d06f3-62d2-45c0-8dd6-db1063bba0ee tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:31.037478 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f92d06f3-62d2-45c0-8dd6-db1063bba0ee tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:31.037920 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f92d06f3-62d2-45c0-8dd6-db1063bba0ee tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:31.164213 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-f92d06f3-62d2-45c0-8dd6-db1063bba0ee tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:31.172366 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f92d06f3-62d2-45c0-8dd6-db1063bba0ee tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1724 microversion: 2.1 time: 0.147322 Jun 22 09:04:31.172951 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 357/661] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:31 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:32.191039 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a18eab13-0a6b-463a-a6fa-e05ee7a55027 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:32.191656 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a18eab13-0a6b-463a-a6fa-e05ee7a55027 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:32.198326 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a18eab13-0a6b-463a-a6fa-e05ee7a55027 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:32.198771 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a18eab13-0a6b-463a-a6fa-e05ee7a55027 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:32.199562 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a18eab13-0a6b-463a-a6fa-e05ee7a55027 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:32.200026 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a18eab13-0a6b-463a-a6fa-e05ee7a55027 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:32.330534 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-a18eab13-0a6b-463a-a6fa-e05ee7a55027 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:32.338547 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a18eab13-0a6b-463a-a6fa-e05ee7a55027 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1701 microversion: 2.1 time: 0.151373 Jun 22 09:04:32.339107 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 305/662] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:32 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1701 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:04:32.355240 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-1b4b769e-279a-4e86-b3d1-d07185be1f1b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:04:32.361916 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1b4b769e-279a-4e86-b3d1-d07185be1f1b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:32.362360 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1b4b769e-279a-4e86-b3d1-d07185be1f1b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:32.422623 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-1b4b769e-279a-4e86-b3d1-d07185be1f1b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Going to try to start instance {{(pid=118025) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 22 09:04:32.622158 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-1b4b769e-279a-4e86-b3d1-d07185be1f1b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "POST /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/action" status: 202 len: 0 microversion: 2.1 time: 0.270414 Jun 22 09:04:32.622712 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 358/663] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jun 22 09:04:32 2022] POST /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:04:32.631164 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-0cce4666-1a20-4e72-8b71-9e738cfb9fe5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:32.631910 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-0cce4666-1a20-4e72-8b71-9e738cfb9fe5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:32.638002 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0cce4666-1a20-4e72-8b71-9e738cfb9fe5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:32.638448 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0cce4666-1a20-4e72-8b71-9e738cfb9fe5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:32.639358 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0cce4666-1a20-4e72-8b71-9e738cfb9fe5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:32.639802 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0cce4666-1a20-4e72-8b71-9e738cfb9fe5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:32.791399 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-0cce4666-1a20-4e72-8b71-9e738cfb9fe5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:32.806043 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-0cce4666-1a20-4e72-8b71-9e738cfb9fe5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1710 microversion: 2.1 time: 0.178851 Jun 22 09:04:32.816364 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 306/664] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:32 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1710 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:32.870835 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-6e1d5ed0-58c6-4aa8-ba9b-245cbd9c0855 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a41d381b-4e22-40c9-8aec-e606e9542cc9"}} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:04:32.872044 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-6e1d5ed0-58c6-4aa8-ba9b-245cbd9c0855 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:32.878393 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6e1d5ed0-58c6-4aa8-ba9b-245cbd9c0855 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:32.878776 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6e1d5ed0-58c6-4aa8-ba9b-245cbd9c0855 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:32.879546 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6e1d5ed0-58c6-4aa8-ba9b-245cbd9c0855 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:32.881474 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6e1d5ed0-58c6-4aa8-ba9b-245cbd9c0855 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:33.606023 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-6e1d5ed0-58c6-4aa8-ba9b-245cbd9c0855 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "POST /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.854564 Jun 22 09:04:33.606720 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 359/665] 10.222.0.16 () {60 vars in 1322 bytes} [Wed Jun 22 09:04:32 2022] POST /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45/os-volume_attachments => generated 194 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:04:33.823750 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6b4ffa40-d864-4573-bd99-e0e5c7f898aa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:33.824354 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-6b4ffa40-d864-4573-bd99-e0e5c7f898aa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:33.830949 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6b4ffa40-d864-4573-bd99-e0e5c7f898aa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:33.831397 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6b4ffa40-d864-4573-bd99-e0e5c7f898aa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:33.832154 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6b4ffa40-d864-4573-bd99-e0e5c7f898aa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:33.832588 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6b4ffa40-d864-4573-bd99-e0e5c7f898aa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:33.965128 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-6b4ffa40-d864-4573-bd99-e0e5c7f898aa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:33.973048 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-6b4ffa40-d864-4573-bd99-e0e5c7f898aa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1710 microversion: 2.1 time: 0.153045 Jun 22 09:04:33.973619 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 307/666] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:33 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1710 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:34.993508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9077564a-b794-4ca0-ba68-9c0cd35c055f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:34.994212 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9077564a-b794-4ca0-ba68-9c0cd35c055f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:35.000580 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9077564a-b794-4ca0-ba68-9c0cd35c055f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:35.001009 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9077564a-b794-4ca0-ba68-9c0cd35c055f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:35.001779 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9077564a-b794-4ca0-ba68-9c0cd35c055f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:35.002224 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9077564a-b794-4ca0-ba68-9c0cd35c055f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:35.139023 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9077564a-b794-4ca0-ba68-9c0cd35c055f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:35.147446 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9077564a-b794-4ca0-ba68-9c0cd35c055f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1710 microversion: 2.1 time: 0.159808 Jun 22 09:04:35.148000 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 360/667] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:34 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1710 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:36.164615 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-99149871-f170-49fd-9894-7e71d6273828 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:36.165254 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-99149871-f170-49fd-9894-7e71d6273828 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:36.171727 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-99149871-f170-49fd-9894-7e71d6273828 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:36.172170 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-99149871-f170-49fd-9894-7e71d6273828 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:36.172963 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-99149871-f170-49fd-9894-7e71d6273828 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:36.173404 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-99149871-f170-49fd-9894-7e71d6273828 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:36.301823 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-99149871-f170-49fd-9894-7e71d6273828 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:36.310471 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-99149871-f170-49fd-9894-7e71d6273828 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1714 microversion: 2.1 time: 0.149734 Jun 22 09:04:36.311018 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 308/668] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:36 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1714 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:53.270889 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:04:53.271332 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Wed Jun 22 09:04:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:04:57.068131 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:04:57.068676 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Wed Jun 22 09:04:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:05:55.883511 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=9 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:05:55.884260 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:05:55.889187 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c843ac53-5d07-4607-add4-2cef107b80a1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:55.893863 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c843ac53-5d07-4607-add4-2cef107b80a1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:55.895779 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c843ac53-5d07-4607-add4-2cef107b80a1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:55.896226 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c843ac53-5d07-4607-add4-2cef107b80a1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:55.897012 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c843ac53-5d07-4607-add4-2cef107b80a1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:55.897444 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c843ac53-5d07-4607-add4-2cef107b80a1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:55.977602 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.objects.instance [None req-c843ac53-5d07-4607-add4-2cef107b80a1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lazy-loading 'services' on Instance uuid b84e6922-9b60-4a6d-8836-4b07ef206590 {{(pid=118025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:05:56.129588 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c843ac53-5d07-4607-add4-2cef107b80a1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments/e0cf66cd-eddb-4d10-8f47-1a33a5d8e11a" status: 202 len: 0 microversion: 2.1 time: 0.247540 Jun 22 09:05:56.130281 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 361/669] 10.222.0.16 () {58 vars in 1415 bytes} [Wed Jun 22 09:05:55 2022] DELETE /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments/e0cf66cd-eddb-4d10-8f47-1a33a5d8e11a => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:06:39.155078 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:06:39.155753 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Wed Jun 22 09:06:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:06:57.577832 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:06:57.578416 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Wed Jun 22 09:06:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:07:54.332628 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:07:54.333267 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Wed Jun 22 09:07:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:08:13.279787 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:08:13.280230 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Wed Jun 22 09:08:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:08:17.077021 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:08:17.077609 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Wed Jun 22 09:08:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:08:39.755482 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:08:39.756023 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Wed Jun 22 09:08:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:09:00.559014 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR oslo.messaging._drivers.impl_rabbit [-] [37c3933e-4411-44e7-89c0-9c9368201568] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 22 09:09:00.559588 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=13 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:00.560746 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=41 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:00.565655 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-e2c47ada-e38c-440b-9f94-70c341a98614 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:00.565655 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-e2c47ada-e38c-440b-9f94-70c341a98614 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:00.571938 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e2c47ada-e38c-440b-9f94-70c341a98614 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:00.572388 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e2c47ada-e38c-440b-9f94-70c341a98614 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:00.573180 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e2c47ada-e38c-440b-9f94-70c341a98614 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:00.573618 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e2c47ada-e38c-440b-9f94-70c341a98614 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:00.736966 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.objects.instance [None req-e2c47ada-e38c-440b-9f94-70c341a98614 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lazy-loading 'services' on Instance uuid fb580ec8-80e7-4908-8761-08e8b136be42 {{(pid=118024) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:09:01.030048 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-e2c47ada-e38c-440b-9f94-70c341a98614 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42/os-volume_attachments/5cfcf7e9-9b1b-4820-ac90-6656e4805006" status: 202 len: 0 microversion: 2.1 time: 0.472935 Jun 22 09:09:01.030661 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 309/670] 10.222.0.16 () {58 vars in 1415 bytes} [Wed Jun 22 09:09:00 2022] DELETE /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42/os-volume_attachments/5cfcf7e9-9b1b-4820-ac90-6656e4805006 => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:09:19.546984 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR oslo.messaging._drivers.impl_rabbit [-] [464973eb-4c05-4793-ab21-ab2184288628] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 22 09:09:19.547511 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=2 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:19.548262 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:19.552723 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-1c3d9780-c950-44c3-a473-d6746372d7aa tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:19.553355 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-1c3d9780-c950-44c3-a473-d6746372d7aa tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:19.560171 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1c3d9780-c950-44c3-a473-d6746372d7aa tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:19.560759 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1c3d9780-c950-44c3-a473-d6746372d7aa tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:19.561419 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1c3d9780-c950-44c3-a473-d6746372d7aa tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:19.561866 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1c3d9780-c950-44c3-a473-d6746372d7aa tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:19.586601 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-1c3d9780-c950-44c3-a473-d6746372d7aa tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Going to try to terminate instance {{(pid=118025) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:09:19.920835 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-1c3d9780-c950-44c3-a473-d6746372d7aa tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 204 len: 0 microversion: 2.1 time: 0.375320 Jun 22 09:09:19.921420 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 362/671] 10.222.0.16 () {58 vars in 1238 bytes} [Wed Jun 22 09:09:19 2022] DELETE /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:09:19.927627 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=2 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:19.928403 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:19.932720 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-440deb33-3837-4f4a-a1af-f2dd089bdc91 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:19.933482 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-440deb33-3837-4f4a-a1af-f2dd089bdc91 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:19.941757 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-440deb33-3837-4f4a-a1af-f2dd089bdc91 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:19.942212 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-440deb33-3837-4f4a-a1af-f2dd089bdc91 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:19.942978 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-440deb33-3837-4f4a-a1af-f2dd089bdc91 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:19.943421 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-440deb33-3837-4f4a-a1af-f2dd089bdc91 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:19.948716 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO oslo.messaging._drivers.impl_rabbit [-] [37c3933e-4411-44e7-89c0-9c9368201568] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33310. Jun 22 09:09:20.129193 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-440deb33-3837-4f4a-a1af-f2dd089bdc91 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:20.136800 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-440deb33-3837-4f4a-a1af-f2dd089bdc91 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1681 microversion: 2.1 time: 0.210819 Jun 22 09:09:20.137399 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 310/672] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:19 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1681 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:21.155101 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-ae999d47-d985-4dac-be4b-78f08f250c0a tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:21.156351 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-ae999d47-d985-4dac-be4b-78f08f250c0a tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:21.164399 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ae999d47-d985-4dac-be4b-78f08f250c0a tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:21.165021 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ae999d47-d985-4dac-be4b-78f08f250c0a tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:21.171312 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ae999d47-d985-4dac-be4b-78f08f250c0a tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:21.171312 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ae999d47-d985-4dac-be4b-78f08f250c0a tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:21.189168 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO oslo.messaging._drivers.impl_rabbit [-] [464973eb-4c05-4793-ab21-ab2184288628] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33332. Jun 22 09:09:21.346746 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-ae999d47-d985-4dac-be4b-78f08f250c0a tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:21.354240 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-ae999d47-d985-4dac-be4b-78f08f250c0a tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1681 microversion: 2.1 time: 0.203507 Jun 22 09:09:21.354799 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 363/673] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:21 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1681 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:22.061769 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [req-ee86c959-2605-4c75-a7c0-d0c40b07339b req-15d4fbad-d2ce-4486-922b-d4e6860e1703 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10", "name": "network-vif-deleted", "tag": "9678ec97-a7d2-4f9c-aa09-000750551309"}]} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:09:22.070117 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-ee86c959-2605-4c75-a7c0-d0c40b07339b req-15d4fbad-d2ce-4486-922b-d4e6860e1703 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:22.076036 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-ee86c959-2605-4c75-a7c0-d0c40b07339b req-15d4fbad-d2ce-4486-922b-d4e6860e1703 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:22.082892 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.compute.server_external_events [req-ee86c959-2605-4c75-a7c0-d0c40b07339b req-15d4fbad-d2ce-4486-922b-d4e6860e1703 service nova] Creating event network-vif-deleted:9678ec97-a7d2-4f9c-aa09-000750551309 for instance cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 on hv-cinder-84599 Jun 22 09:09:22.088416 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [req-ee86c959-2605-4c75-a7c0-d0c40b07339b req-15d4fbad-d2ce-4486-922b-d4e6860e1703 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092324 Jun 22 09:09:22.089233 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 311/674] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:09:22.373178 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-6a826e4b-6cec-457f-a1e0-222cffec8534 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:22.374486 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-6a826e4b-6cec-457f-a1e0-222cffec8534 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:22.381989 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6a826e4b-6cec-457f-a1e0-222cffec8534 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:22.382701 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6a826e4b-6cec-457f-a1e0-222cffec8534 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:22.383481 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6a826e4b-6cec-457f-a1e0-222cffec8534 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:22.383924 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6a826e4b-6cec-457f-a1e0-222cffec8534 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:22.416163 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6a826e4b-6cec-457f-a1e0-222cffec8534 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:22.416619 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6a826e4b-6cec-457f-a1e0-222cffec8534 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:22.417374 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.objects.instance [None req-6a826e4b-6cec-457f-a1e0-222cffec8534 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lazy-loading 'fault' on Instance uuid cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 {{(pid=118025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:09:22.462488 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-6a826e4b-6cec-457f-a1e0-222cffec8534 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:22.470478 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-6a826e4b-6cec-457f-a1e0-222cffec8534 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 200 len: 1331 microversion: 2.1 time: 0.102683 Jun 22 09:09:22.471390 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 364/675] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:22 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:23.488885 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6a73ead5-507c-4138-9300-5a7ec1eacddc tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:23.489584 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-6a73ead5-507c-4138-9300-5a7ec1eacddc tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:23.495792 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6a73ead5-507c-4138-9300-5a7ec1eacddc tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:23.496246 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6a73ead5-507c-4138-9300-5a7ec1eacddc tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:23.497533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6a73ead5-507c-4138-9300-5a7ec1eacddc tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:23.498056 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6a73ead5-507c-4138-9300-5a7ec1eacddc tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:23.510900 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.wsgi [None req-6a73ead5-507c-4138-9300-5a7ec1eacddc tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] HTTP exception thrown: Instance cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 could not be found. Jun 22 09:09:23.513289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6a73ead5-507c-4138-9300-5a7ec1eacddc tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Request method failure captured: Jun 22 09:09:23.513289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: request: GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 HTTP/1.1 Jun 22 09:09:23.513289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept: application/json Jun 22 09:09:23.513289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept-Encoding: identity Jun 22 09:09:23.513289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Connection: close Jun 22 09:09:23.513289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Length: 0 Jun 22 09:09:23.513289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Type: application/json Jun 22 09:09:23.513289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Host: 10.222.0.16 Jun 22 09:09:23.513289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Openstack-System-Scope: None Jun 22 09:09:23.513289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: User-Agent: python-urllib3/1.26.9 Jun 22 09:09:23.513289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Auth-Token: gAAAAABistmqD47tOpCEfZxXQ7v8d4kDBzbZcFIWDuyhnuGnU13mxMlhbgt18xo2M0HJq-gXeYBWo0pfkDLuGB3yaG8TUwjVHhSVzhHn4vsUiwL4uQjCeCtk_V7_A6rYsksudlP-79icDu6EqbcTRNIwpnAGEp7HhBlOtNGTaFEH_UUlynGlRmI Jun 22 09:09:23.513289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Id: None Jun 22 09:09:23.513289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Name: None Jun 22 09:09:23.513289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Identity-Status: Confirmed Jun 22 09:09:23.513289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Is-Admin-Project: True Jun 22 09:09:23.513289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Id: default Jun 22 09:09:23.513289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Name: Default Jun 22 09:09:23.513289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Id: 9ebdcb9809a84f25bd578f8aca09802c Jun 22 09:09:23.513289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Name: tempest-AttachVolumeNegativeTest-914919780 Jun 22 09:09:23.513289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Role: member,reader Jun 22 09:09:23.513289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Roles: member,reader Jun 22 09:09:23.514844 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebdcb9809a84f25bd578f8aca09802c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebdcb9809a84f25bd578f8aca09802c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ebdcb9809a84f25bd578f8aca09802c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ebdcb9809a84f25bd578f8aca09802c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:09:23.514844 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant: tempest-AttachVolumeNegativeTest-914919780 Jun 22 09:09:23.514844 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Id: 9ebdcb9809a84f25bd578f8aca09802c Jun 22 09:09:23.514844 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-914919780 Jun 22 09:09:23.514844 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User: tempest-AttachVolumeNegativeTest-914919780-project Jun 22 09:09:23.514844 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Id: default Jun 22 09:09:23.514844 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Name: Default Jun 22 09:09:23.514844 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Id: 71ea2610ccc044de9d66444b4038fe9e Jun 22 09:09:23.514844 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Name: tempest-AttachVolumeNegativeTest-914919780-project Jun 22 09:09:23.514844 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: method: > Jun 22 09:09:23.514844 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: exception: Instance cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 could not be found. Jun 22 09:09:23.514844 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: action_args: {'id': 'cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10'} Jun 22 09:09:23.519143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:09:23.519143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:09:23.519143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:09:23.519143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:09:23.519143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:09:23.519143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:09:23.519143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:09:23.519143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:09:23.519143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:09:23.519143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:09:23.519143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 could not be found. Jun 22 09:09:23.519143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:09:23.519143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:09:23.519143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:09:23.519143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:09:23.519143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:09:23.519143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:09:23.519143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:09:23.519143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:09:23.519143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:09:23.520653 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:09:23.520653 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:09:23.520653 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:09:23.520653 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:09:23.520653 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:09:23.520653 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:09:23.520653 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:09:23.520653 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 could not be found. Jun 22 09:09:23.520653 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:09:23.520653 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:09:23.520653 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:09:23.520653 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:09:23.520653 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:09:23.520653 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:09:23.520653 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:09:23.520653 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:09:23.520653 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 could not be found. Jun 22 09:09:23.520653 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:09:23.522027 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6a73ead5-507c-4138-9300-5a7ec1eacddc tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Returning 404 to user: Instance cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 could not be found. {{(pid=118024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:09:23.522027 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-6a73ead5-507c-4138-9300-5a7ec1eacddc tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 404 len: 111 microversion: 2.1 time: 0.030664 Jun 22 09:09:23.522027 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 312/676] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:23 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:09:23.527113 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-04480e26-e94c-429e-b90c-3b5203e96d15 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '.version_select at 0x7f5756156af0>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:23.611735 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-04480e26-e94c-429e-b90c-3b5203e96d15 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1053939892" status: 202 len: 0 microversion: 2.1 time: 0.086633 Jun 22 09:09:23.611735 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 365/677] 10.222.0.16 () {58 vars in 1220 bytes} [Wed Jun 22 09:09:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1053939892 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:09:24.479207 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3b7dcf39-70f3-4e01-9a1e-874e5b81ff4b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Action: 'create', calling method: .version_select at 0x7f575621eca0>, body: {"keypair": {"name": "tempest-keypair-111095477", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTjL6MAtB7V2zNAkw9099O6WkbSQiNeO1o78iiDysc833AjSeADJfIoCthfKLEziVJ0ChSKKY/hzlsushWIIwSBh2fo76KPrMaf5CtiPxbBYs6otnnhxOFxPdBqYo1zWg=="}} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:09:24.493864 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.quota [None req-3b7dcf39-70f3-4e01-9a1e-874e5b81ff4b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Getting quotas for project 9ebdcb9809a84f25bd578f8aca09802c. Resources: {'key_pairs'} {{(pid=118024) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:09:24.497602 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.quota [None req-3b7dcf39-70f3-4e01-9a1e-874e5b81ff4b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Getting quotas for user 71ea2610ccc044de9d66444b4038fe9e and project 9ebdcb9809a84f25bd578f8aca09802c. Resources: {'key_pairs'} {{(pid=118024) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:09:24.580600 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3b7dcf39-70f3-4e01-9a1e-874e5b81ff4b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.105350 Jun 22 09:09:24.581308 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 313/678] 10.222.0.16 () {60 vars in 1158 bytes} [Wed Jun 22 09:09:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:09:26.953120 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e7e462db-a473-4c95-ac73-52a70a338af0 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-563159939", "imageRef": "c24d36a8-7909-4174-9b12-42c8d76647ac", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "32fd7d44-45b4-465a-a792-69017447bde6"}], "security_groups": [{"name": "tempest-securitygroup--83306833"}], "key_name": "tempest-keypair-111095477", "user_data": "}} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:09:27.054263 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.network.neutron [None req-e7e462db-a473-4c95-ac73-52a70a338af0 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] validate_networks() for [('32fd7d44-45b4-465a-a792-69017447bde6', None, None, None, None, None)] {{(pid=118025) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:09:27.467860 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-e7e462db-a473-4c95-ac73-52a70a338af0 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Flavor limits 0:0:0 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:09:27.468292 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-e7e462db-a473-4c95-ac73-52a70a338af0 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Image limits 0:0:0 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:09:27.468801 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-e7e462db-a473-4c95-ac73-52a70a338af0 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Flavor pref 0:0:0 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:09:27.469212 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-e7e462db-a473-4c95-ac73-52a70a338af0 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Image pref 0:0:0 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:09:27.469629 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-e7e462db-a473-4c95-ac73-52a70a338af0 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:09:27.478335 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e7e462db-a473-4c95-ac73-52a70a338af0 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:27.478788 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e7e462db-a473-4c95-ac73-52a70a338af0 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:27.479588 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e7e462db-a473-4c95-ac73-52a70a338af0 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:27.480030 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e7e462db-a473-4c95-ac73-52a70a338af0 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:27.500181 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.quota [None req-e7e462db-a473-4c95-ac73-52a70a338af0 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Getting quotas for project 9ebdcb9809a84f25bd578f8aca09802c. Resources: {'cores', 'instances', 'ram'} {{(pid=118025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:09:27.504184 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.quota [None req-e7e462db-a473-4c95-ac73-52a70a338af0 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Getting quotas for user 71ea2610ccc044de9d66444b4038fe9e and project 9ebdcb9809a84f25bd578f8aca09802c. Resources: {'cores', 'instances', 'ram'} {{(pid=118025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:09:27.515118 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e7e462db-a473-4c95-ac73-52a70a338af0 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Going to run 1 instances... {{(pid=118025) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:09:27.517393 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e7e462db-a473-4c95-ac73-52a70a338af0 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: f5dbd1b0-e21e-46fd-818b-da300c8cf1e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c24d36a8-7909-4174-9b12-42c8d76647ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:09:27.640185 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e7e462db-a473-4c95-ac73-52a70a338af0 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.691972 Jun 22 09:09:27.640851 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 366/679] 10.222.0.16 () {60 vars in 1146 bytes} [Wed Jun 22 09:09:26 2022] POST /compute/v2.1/servers => generated 400 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:09:27.651565 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6a836713-f45a-4ce0-8cf3-6bda8a7284ff tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:27.652276 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-6a836713-f45a-4ce0-8cf3-6bda8a7284ff tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: f5dbd1b0-e21e-46fd-818b-da300c8cf1e7] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:27.709176 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-6a836713-f45a-4ce0-8cf3-6bda8a7284ff tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:27.716994 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-6a836713-f45a-4ce0-8cf3-6bda8a7284ff tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7" status: 200 len: 1240 microversion: 2.1 time: 0.069999 Jun 22 09:09:27.717553 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 314/680] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:27 2022] GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:28.735420 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c36253f8-6096-4797-b779-beb7f3e44236 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:28.735979 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c36253f8-6096-4797-b779-beb7f3e44236 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: f5dbd1b0-e21e-46fd-818b-da300c8cf1e7] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:28.742559 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c36253f8-6096-4797-b779-beb7f3e44236 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:28.743020 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c36253f8-6096-4797-b779-beb7f3e44236 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:28.743753 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c36253f8-6096-4797-b779-beb7f3e44236 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:28.744188 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c36253f8-6096-4797-b779-beb7f3e44236 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:28.812258 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c36253f8-6096-4797-b779-beb7f3e44236 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:28.819942 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c36253f8-6096-4797-b779-beb7f3e44236 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7" status: 200 len: 1236 microversion: 2.1 time: 0.089524 Jun 22 09:09:28.820507 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 367/681] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:28 2022] GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 => generated 1236 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:29.837423 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a8349124-b5f2-4aed-b652-a3cd91a0d671 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:29.838104 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a8349124-b5f2-4aed-b652-a3cd91a0d671 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: f5dbd1b0-e21e-46fd-818b-da300c8cf1e7] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:29.844628 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a8349124-b5f2-4aed-b652-a3cd91a0d671 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:29.845109 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a8349124-b5f2-4aed-b652-a3cd91a0d671 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:29.845860 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a8349124-b5f2-4aed-b652-a3cd91a0d671 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:29.846290 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a8349124-b5f2-4aed-b652-a3cd91a0d671 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:29.909518 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-a8349124-b5f2-4aed-b652-a3cd91a0d671 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:29.917617 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a8349124-b5f2-4aed-b652-a3cd91a0d671 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7" status: 200 len: 1310 microversion: 2.1 time: 0.084036 Jun 22 09:09:29.919271 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 315/682] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:29 2022] GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:30.941014 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7473da20-55de-4426-bbd5-639fec75f5c1 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:30.941740 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7473da20-55de-4426-bbd5-639fec75f5c1 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: f5dbd1b0-e21e-46fd-818b-da300c8cf1e7] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:30.948752 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7473da20-55de-4426-bbd5-639fec75f5c1 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:30.949235 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7473da20-55de-4426-bbd5-639fec75f5c1 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:30.950164 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7473da20-55de-4426-bbd5-639fec75f5c1 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:30.950421 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7473da20-55de-4426-bbd5-639fec75f5c1 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:31.095499 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7473da20-55de-4426-bbd5-639fec75f5c1 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:31.103607 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7473da20-55de-4426-bbd5-639fec75f5c1 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7" status: 200 len: 1364 microversion: 2.1 time: 0.166631 Jun 22 09:09:31.104328 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 368/683] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:30 2022] GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:31.596548 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [req-1f1da5bf-1109-40e0-bda6-0231ece89c09 req-7ed267e0-51b9-453c-933d-c824ed3b9cde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5dbd1b0-e21e-46fd-818b-da300c8cf1e7", "tag": "edb7b6e6-c1cd-48e0-a71d-abbc95680749"}]} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:09:31.608764 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-1f1da5bf-1109-40e0-bda6-0231ece89c09 req-7ed267e0-51b9-453c-933d-c824ed3b9cde service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:31.617239 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-1f1da5bf-1109-40e0-bda6-0231ece89c09 req-7ed267e0-51b9-453c-933d-c824ed3b9cde service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:31.626689 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.compute.server_external_events [req-1f1da5bf-1109-40e0-bda6-0231ece89c09 req-7ed267e0-51b9-453c-933d-c824ed3b9cde service nova] Creating event network-changed:edb7b6e6-c1cd-48e0-a71d-abbc95680749 for instance f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 on hv-cinder-84599 Jun 22 09:09:31.631943 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [req-1f1da5bf-1109-40e0-bda6-0231ece89c09 req-7ed267e0-51b9-453c-933d-c824ed3b9cde service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039238 Jun 22 09:09:31.632551 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 316/684] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:09:32.123622 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a5f1ea11-ed15-4417-9815-53db6372323b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:32.124299 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-a5f1ea11-ed15-4417-9815-53db6372323b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: f5dbd1b0-e21e-46fd-818b-da300c8cf1e7] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:32.131721 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a5f1ea11-ed15-4417-9815-53db6372323b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:32.132262 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a5f1ea11-ed15-4417-9815-53db6372323b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:32.133201 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a5f1ea11-ed15-4417-9815-53db6372323b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:32.133824 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a5f1ea11-ed15-4417-9815-53db6372323b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:32.272876 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-a5f1ea11-ed15-4417-9815-53db6372323b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:32.281362 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a5f1ea11-ed15-4417-9815-53db6372323b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7" status: 200 len: 1364 microversion: 2.1 time: 0.161664 Jun 22 09:09:32.281943 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 369/685] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:32 2022] GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:33.298655 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f98a0d58-c04d-4b08-b03c-dbca988205c5 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:33.299363 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f98a0d58-c04d-4b08-b03c-dbca988205c5 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: f5dbd1b0-e21e-46fd-818b-da300c8cf1e7] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:33.305716 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f98a0d58-c04d-4b08-b03c-dbca988205c5 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:33.306173 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f98a0d58-c04d-4b08-b03c-dbca988205c5 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:33.306937 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f98a0d58-c04d-4b08-b03c-dbca988205c5 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:33.307378 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f98a0d58-c04d-4b08-b03c-dbca988205c5 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:33.438778 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-f98a0d58-c04d-4b08-b03c-dbca988205c5 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:33.446193 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f98a0d58-c04d-4b08-b03c-dbca988205c5 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7" status: 200 len: 1364 microversion: 2.1 time: 0.152421 Jun 22 09:09:33.446746 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 317/686] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:33 2022] GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:34.463384 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-388d583b-2d9b-4f36-8425-303477b8e439 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:34.463927 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-388d583b-2d9b-4f36-8425-303477b8e439 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: f5dbd1b0-e21e-46fd-818b-da300c8cf1e7] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:34.471113 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-388d583b-2d9b-4f36-8425-303477b8e439 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:34.471558 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-388d583b-2d9b-4f36-8425-303477b8e439 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:34.472311 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-388d583b-2d9b-4f36-8425-303477b8e439 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:34.472746 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-388d583b-2d9b-4f36-8425-303477b8e439 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:34.601867 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-388d583b-2d9b-4f36-8425-303477b8e439 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:34.609366 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-388d583b-2d9b-4f36-8425-303477b8e439 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7" status: 200 len: 1364 microversion: 2.1 time: 0.149904 Jun 22 09:09:34.609926 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 370/687] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:34 2022] GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:35.626427 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-fd13895e-bdf9-411a-a9df-80a52e3659eb tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:35.627040 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-fd13895e-bdf9-411a-a9df-80a52e3659eb tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: f5dbd1b0-e21e-46fd-818b-da300c8cf1e7] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:35.633592 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fd13895e-bdf9-411a-a9df-80a52e3659eb tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:35.634047 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fd13895e-bdf9-411a-a9df-80a52e3659eb tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:35.634813 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fd13895e-bdf9-411a-a9df-80a52e3659eb tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:35.635253 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fd13895e-bdf9-411a-a9df-80a52e3659eb tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:35.759869 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-fd13895e-bdf9-411a-a9df-80a52e3659eb tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:35.767769 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-fd13895e-bdf9-411a-a9df-80a52e3659eb tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7" status: 200 len: 1364 microversion: 2.1 time: 0.145617 Jun 22 09:09:35.768322 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 318/688] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:35 2022] GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:36.783748 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-bc1cb8c1-c6a2-4c5f-974d-0af2a165b9ff tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:36.784345 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-bc1cb8c1-c6a2-4c5f-974d-0af2a165b9ff tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: f5dbd1b0-e21e-46fd-818b-da300c8cf1e7] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:36.790898 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bc1cb8c1-c6a2-4c5f-974d-0af2a165b9ff tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:36.791349 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bc1cb8c1-c6a2-4c5f-974d-0af2a165b9ff tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:36.792365 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bc1cb8c1-c6a2-4c5f-974d-0af2a165b9ff tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:36.792817 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bc1cb8c1-c6a2-4c5f-974d-0af2a165b9ff tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:36.919074 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-bc1cb8c1-c6a2-4c5f-974d-0af2a165b9ff tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:36.926989 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-bc1cb8c1-c6a2-4c5f-974d-0af2a165b9ff tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7" status: 200 len: 1364 microversion: 2.1 time: 0.147152 Jun 22 09:09:36.927549 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 371/689] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:36 2022] GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:37.944025 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6b6291c4-688f-4dfd-b246-d548d57a5a33 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:37.944629 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-6b6291c4-688f-4dfd-b246-d548d57a5a33 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: f5dbd1b0-e21e-46fd-818b-da300c8cf1e7] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:37.947020 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell0:SELECT=6 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:37.952394 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6b6291c4-688f-4dfd-b246-d548d57a5a33 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:37.952865 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6b6291c4-688f-4dfd-b246-d548d57a5a33 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:37.953676 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6b6291c4-688f-4dfd-b246-d548d57a5a33 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:37.954108 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6b6291c4-688f-4dfd-b246-d548d57a5a33 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:38.090578 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-6b6291c4-688f-4dfd-b246-d548d57a5a33 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:38.099266 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-6b6291c4-688f-4dfd-b246-d548d57a5a33 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7" status: 200 len: 1364 microversion: 2.1 time: 0.158985 Jun 22 09:09:38.100245 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 319/690] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:37 2022] GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:39.116684 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c4ed250e-b326-4777-8682-fdc89cb2f7c4 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:39.117323 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c4ed250e-b326-4777-8682-fdc89cb2f7c4 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: f5dbd1b0-e21e-46fd-818b-da300c8cf1e7] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:39.119153 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell0:SELECT=2 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:39.119819 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell0:SELECT=6 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:39.125071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c4ed250e-b326-4777-8682-fdc89cb2f7c4 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:39.131637 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c4ed250e-b326-4777-8682-fdc89cb2f7c4 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:39.131637 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c4ed250e-b326-4777-8682-fdc89cb2f7c4 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:39.131637 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c4ed250e-b326-4777-8682-fdc89cb2f7c4 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:39.258220 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c4ed250e-b326-4777-8682-fdc89cb2f7c4 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:39.266230 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c4ed250e-b326-4777-8682-fdc89cb2f7c4 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7" status: 200 len: 1364 microversion: 2.1 time: 0.153338 Jun 22 09:09:39.266804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 372/691] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:39 2022] GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:39.478201 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [req-07554641-330a-4c76-bdbe-ed3dbb455b58 req-38bc4890-3d1d-4477-855c-4915c7bc00ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5dbd1b0-e21e-46fd-818b-da300c8cf1e7", "name": "network-vif-plugged", "status": "completed", "tag": "edb7b6e6-c1cd-48e0-a71d-abbc95680749"}]} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:09:39.486549 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-07554641-330a-4c76-bdbe-ed3dbb455b58 req-38bc4890-3d1d-4477-855c-4915c7bc00ca service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:39.486945 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-07554641-330a-4c76-bdbe-ed3dbb455b58 req-38bc4890-3d1d-4477-855c-4915c7bc00ca service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:39.499493 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.compute.server_external_events [req-07554641-330a-4c76-bdbe-ed3dbb455b58 req-38bc4890-3d1d-4477-855c-4915c7bc00ca service nova] Creating event network-vif-plugged:edb7b6e6-c1cd-48e0-a71d-abbc95680749 for instance f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 on hv-cinder-84599 Jun 22 09:09:39.504747 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [req-07554641-330a-4c76-bdbe-ed3dbb455b58 req-38bc4890-3d1d-4477-855c-4915c7bc00ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092663 Jun 22 09:09:39.505368 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 320/692] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:09:40.282859 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-ae752ee5-6f5a-4cda-a9a8-1aa16748bb38 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:40.283473 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-ae752ee5-6f5a-4cda-a9a8-1aa16748bb38 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: f5dbd1b0-e21e-46fd-818b-da300c8cf1e7] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:40.290020 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ae752ee5-6f5a-4cda-a9a8-1aa16748bb38 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:40.290467 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ae752ee5-6f5a-4cda-a9a8-1aa16748bb38 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:40.291233 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ae752ee5-6f5a-4cda-a9a8-1aa16748bb38 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:40.291931 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ae752ee5-6f5a-4cda-a9a8-1aa16748bb38 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:40.421072 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-ae752ee5-6f5a-4cda-a9a8-1aa16748bb38 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:40.428522 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-ae752ee5-6f5a-4cda-a9a8-1aa16748bb38 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7" status: 200 len: 1364 microversion: 2.1 time: 0.150104 Jun 22 09:09:40.429119 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 373/693] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:40 2022] GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:41.446728 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-096d99b8-41af-444a-911f-37bdd551b67b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:41.447329 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-096d99b8-41af-444a-911f-37bdd551b67b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: f5dbd1b0-e21e-46fd-818b-da300c8cf1e7] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:41.453640 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-096d99b8-41af-444a-911f-37bdd551b67b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:41.454085 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-096d99b8-41af-444a-911f-37bdd551b67b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:41.454836 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-096d99b8-41af-444a-911f-37bdd551b67b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:41.455265 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-096d99b8-41af-444a-911f-37bdd551b67b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:41.583715 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-096d99b8-41af-444a-911f-37bdd551b67b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:41.592236 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-096d99b8-41af-444a-911f-37bdd551b67b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7" status: 200 len: 1364 microversion: 2.1 time: 0.150220 Jun 22 09:09:41.592868 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 321/694] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:41 2022] GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:42.609899 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-897fb33e-19f4-4d92-a07d-e6023463e389 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:42.610565 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-897fb33e-19f4-4d92-a07d-e6023463e389 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: f5dbd1b0-e21e-46fd-818b-da300c8cf1e7] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:42.623603 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-897fb33e-19f4-4d92-a07d-e6023463e389 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:42.624142 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-897fb33e-19f4-4d92-a07d-e6023463e389 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:42.625000 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-897fb33e-19f4-4d92-a07d-e6023463e389 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:42.625438 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-897fb33e-19f4-4d92-a07d-e6023463e389 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:42.776410 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-897fb33e-19f4-4d92-a07d-e6023463e389 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:42.783966 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-897fb33e-19f4-4d92-a07d-e6023463e389 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7" status: 200 len: 1554 microversion: 2.1 time: 0.178480 Jun 22 09:09:42.784530 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 374/695] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:42 2022] GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 => generated 1554 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:42.802210 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-e3a434a0-e3a1-4c5a-b81f-9d69c1063ae1 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:42.802717 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-e3a434a0-e3a1-4c5a-b81f-9d69c1063ae1 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: f5dbd1b0-e21e-46fd-818b-da300c8cf1e7] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:42.809331 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e3a434a0-e3a1-4c5a-b81f-9d69c1063ae1 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:42.810325 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e3a434a0-e3a1-4c5a-b81f-9d69c1063ae1 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:42.811181 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e3a434a0-e3a1-4c5a-b81f-9d69c1063ae1 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:42.811615 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e3a434a0-e3a1-4c5a-b81f-9d69c1063ae1 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:42.886346 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-e3a434a0-e3a1-4c5a-b81f-9d69c1063ae1 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088126 Jun 22 09:09:42.886957 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 322/696] 10.222.0.16 () {58 vars in 1274 bytes} [Wed Jun 22 09:09:42 2022] GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:09:44.152470 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-7405e3bf-6dd8-4475-8120-1d7f64a99ed7 req-2dcba12c-fc98-4119-88e8-6e8d53b92525 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5dbd1b0-e21e-46fd-818b-da300c8cf1e7", "tag": "edb7b6e6-c1cd-48e0-a71d-abbc95680749"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:09:44.160799 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-7405e3bf-6dd8-4475-8120-1d7f64a99ed7 req-2dcba12c-fc98-4119-88e8-6e8d53b92525 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:44.161251 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-7405e3bf-6dd8-4475-8120-1d7f64a99ed7 req-2dcba12c-fc98-4119-88e8-6e8d53b92525 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:44.172810 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-7405e3bf-6dd8-4475-8120-1d7f64a99ed7 req-2dcba12c-fc98-4119-88e8-6e8d53b92525 service nova] Creating event network-changed:edb7b6e6-c1cd-48e0-a71d-abbc95680749 for instance f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 on hv-cinder-84599 Jun 22 09:09:44.177977 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-7405e3bf-6dd8-4475-8120-1d7f64a99ed7 req-2dcba12c-fc98-4119-88e8-6e8d53b92525 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086057 Jun 22 09:09:44.178734 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 375/697] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:09:58.429712 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:58.430476 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=48 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:58.435266 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-89c39a5a-8969-4fa6-915f-ccdf05edaabc tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:58.441534 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-89c39a5a-8969-4fa6-915f-ccdf05edaabc tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:58.441832 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-89c39a5a-8969-4fa6-915f-ccdf05edaabc tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:58.442043 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-89c39a5a-8969-4fa6-915f-ccdf05edaabc tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:58.442807 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-89c39a5a-8969-4fa6-915f-ccdf05edaabc tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:58.443240 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-89c39a5a-8969-4fa6-915f-ccdf05edaabc tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:58.470244 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-89c39a5a-8969-4fa6-915f-ccdf05edaabc tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Going to try to terminate instance {{(pid=118024) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:09:58.812478 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-89c39a5a-8969-4fa6-915f-ccdf05edaabc tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 204 len: 0 microversion: 2.20 time: 0.383992 Jun 22 09:09:58.813122 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 323/698] 10.222.0.16 () {60 vars in 1279 bytes} [Wed Jun 22 09:09:58 2022] DELETE /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 22 09:09:58.819195 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:58.822828 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:58.823997 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-ba124741-1626-490d-96f7-4e6ad5e555a3 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:58.825343 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-ba124741-1626-490d-96f7-4e6ad5e555a3 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:58.831424 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ba124741-1626-490d-96f7-4e6ad5e555a3 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:58.831903 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ba124741-1626-490d-96f7-4e6ad5e555a3 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:58.832676 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ba124741-1626-490d-96f7-4e6ad5e555a3 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:58.833149 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ba124741-1626-490d-96f7-4e6ad5e555a3 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:58.962543 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-ba124741-1626-490d-96f7-4e6ad5e555a3 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:58.970649 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-ba124741-1626-490d-96f7-4e6ad5e555a3 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:58.972204 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-ba124741-1626-490d-96f7-4e6ad5e555a3 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:58.973388 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-ba124741-1626-490d-96f7-4e6ad5e555a3 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1722 microversion: 2.20 time: 0.155812 Jun 22 09:09:58.973972 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 376/699] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 09:09:58 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:09:59.992556 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-35228c75-7498-40c6-90a2-550162feb0d9 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:59.993292 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-35228c75-7498-40c6-90a2-550162feb0d9 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:59.999773 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-35228c75-7498-40c6-90a2-550162feb0d9 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:00.000223 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-35228c75-7498-40c6-90a2-550162feb0d9 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:00.001051 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-35228c75-7498-40c6-90a2-550162feb0d9 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:00.001495 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-35228c75-7498-40c6-90a2-550162feb0d9 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:00.132384 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-35228c75-7498-40c6-90a2-550162feb0d9 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:00.141885 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-35228c75-7498-40c6-90a2-550162feb0d9 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:00.143503 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-35228c75-7498-40c6-90a2-550162feb0d9 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:00.144736 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-35228c75-7498-40c6-90a2-550162feb0d9 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1722 microversion: 2.20 time: 0.156454 Jun 22 09:10:00.145397 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 324/700] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 09:09:59 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:00.689417 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-8094af12-316a-4a5c-94dd-0d9146004321 req-7b779c8a-ae0b-48e8-b3e8-4499dfd71972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dce83571-cd21-48a3-b54d-b6218f563363", "name": "network-vif-deleted", "tag": "9ecba298-5328-4f62-bebc-dac62013eb8f"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:10:00.699026 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-8094af12-316a-4a5c-94dd-0d9146004321 req-7b779c8a-ae0b-48e8-b3e8-4499dfd71972 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:00.711467 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-8094af12-316a-4a5c-94dd-0d9146004321 req-7b779c8a-ae0b-48e8-b3e8-4499dfd71972 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:00.711467 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-8094af12-316a-4a5c-94dd-0d9146004321 req-7b779c8a-ae0b-48e8-b3e8-4499dfd71972 service nova] Creating event network-vif-deleted:9ecba298-5328-4f62-bebc-dac62013eb8f for instance dce83571-cd21-48a3-b54d-b6218f563363 on hv-cinder-84599 Jun 22 09:10:00.716613 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-8094af12-316a-4a5c-94dd-0d9146004321 req-7b779c8a-ae0b-48e8-b3e8-4499dfd71972 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032515 Jun 22 09:10:00.717305 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 377/701] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:10:01.163736 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-14ea22d3-7e64-4900-b5ce-bc86d36bb703 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:01.164976 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-14ea22d3-7e64-4900-b5ce-bc86d36bb703 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:01.175026 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-14ea22d3-7e64-4900-b5ce-bc86d36bb703 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:01.175488 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-14ea22d3-7e64-4900-b5ce-bc86d36bb703 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:01.179020 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-14ea22d3-7e64-4900-b5ce-bc86d36bb703 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:01.179020 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-14ea22d3-7e64-4900-b5ce-bc86d36bb703 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:01.219303 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-14ea22d3-7e64-4900-b5ce-bc86d36bb703 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:01.219800 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-14ea22d3-7e64-4900-b5ce-bc86d36bb703 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:01.220254 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.objects.instance [None req-14ea22d3-7e64-4900-b5ce-bc86d36bb703 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lazy-loading 'fault' on Instance uuid dce83571-cd21-48a3-b54d-b6218f563363 {{(pid=118024) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:10:01.265274 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-14ea22d3-7e64-4900-b5ce-bc86d36bb703 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:01.273262 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-14ea22d3-7e64-4900-b5ce-bc86d36bb703 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:01.274796 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-14ea22d3-7e64-4900-b5ce-bc86d36bb703 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:01.275957 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-14ea22d3-7e64-4900-b5ce-bc86d36bb703 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 200 len: 1371 microversion: 2.20 time: 0.116393 Jun 22 09:10:01.276523 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 325/702] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:01 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 1371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:10:02.296395 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e2ba475e-034b-43c0-8914-cb3b36d8b387 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:02.297135 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e2ba475e-034b-43c0-8914-cb3b36d8b387 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:02.304309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e2ba475e-034b-43c0-8914-cb3b36d8b387 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:02.304761 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e2ba475e-034b-43c0-8914-cb3b36d8b387 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:02.305539 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e2ba475e-034b-43c0-8914-cb3b36d8b387 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:02.305980 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e2ba475e-034b-43c0-8914-cb3b36d8b387 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:02.318926 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.wsgi [None req-e2ba475e-034b-43c0-8914-cb3b36d8b387 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] HTTP exception thrown: Instance dce83571-cd21-48a3-b54d-b6218f563363 could not be found. Jun 22 09:10:02.331363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e2ba475e-034b-43c0-8914-cb3b36d8b387 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Request method failure captured: Jun 22 09:10:02.331363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: request: GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 HTTP/1.1 Jun 22 09:10:02.331363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept: application/json Jun 22 09:10:02.331363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept-Encoding: identity Jun 22 09:10:02.331363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Connection: close Jun 22 09:10:02.331363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Length: 0 Jun 22 09:10:02.331363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Type: application/json Jun 22 09:10:02.331363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Host: 10.222.0.16 Jun 22 09:10:02.331363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Openstack-System-Scope: None Jun 22 09:10:02.331363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: User-Agent: python-urllib3/1.26.9 Jun 22 09:10:02.331363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Auth-Token: gAAAAABistmshaECFGAHnRmYa6rYBXSOVD0Qua4uTG5avt1MhcK74DWY3z7j33DyNyPUEHkNAlpnveIdxiQXR4PVctEysp2-oZYhmBZfOkICvSxCioSV-tQOnSDfZ3AGE3xsfOtBMU0bgwdFz6BzWaVEfy2YGlGG8lqZlzBcaQ5nCEgZDL5ggws Jun 22 09:10:02.331363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Id: None Jun 22 09:10:02.331363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Name: None Jun 22 09:10:02.331363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Identity-Status: Confirmed Jun 22 09:10:02.331363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Is-Admin-Project: True Jun 22 09:10:02.331363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 09:10:02.331363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Id: default Jun 22 09:10:02.331363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Name: Default Jun 22 09:10:02.331363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Id: b172c496b3304444bd6169a09cff85d2 Jun 22 09:10:02.331363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2111643669 Jun 22 09:10:02.331363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Role: member,reader Jun 22 09:10:02.331363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Roles: member,reader Jun 22 09:10:02.333134 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b172c496b3304444bd6169a09cff85d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b172c496b3304444bd6169a09cff85d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b172c496b3304444bd6169a09cff85d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b172c496b3304444bd6169a09cff85d2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:10:02.333134 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2111643669 Jun 22 09:10:02.333134 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Id: b172c496b3304444bd6169a09cff85d2 Jun 22 09:10:02.333134 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2111643669 Jun 22 09:10:02.333134 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User: tempest-AttachVolumeShelveTestJSON-2111643669-project Jun 22 09:10:02.333134 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Id: default Jun 22 09:10:02.333134 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Name: Default Jun 22 09:10:02.333134 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Id: dc534f42584b4e57a4706c81729cacd5 Jun 22 09:10:02.333134 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2111643669-project Jun 22 09:10:02.333134 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: method: > Jun 22 09:10:02.333134 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: exception: Instance dce83571-cd21-48a3-b54d-b6218f563363 could not be found. Jun 22 09:10:02.333134 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: action_args: {'id': 'dce83571-cd21-48a3-b54d-b6218f563363'} Jun 22 09:10:02.334076 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:10:02.334076 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:10:02.334076 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:10:02.334076 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:10:02.334076 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:10:02.334076 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:10:02.334076 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:10:02.334076 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:10:02.334076 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:10:02.334076 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:10:02.334076 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dce83571-cd21-48a3-b54d-b6218f563363 could not be found. Jun 22 09:10:02.334076 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:10:02.334076 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:10:02.334076 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:10:02.334076 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:10:02.334076 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:10:02.334076 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:10:02.334076 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:10:02.334076 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:10:02.334076 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:10:02.335639 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:10:02.335639 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:10:02.335639 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:10:02.335639 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:10:02.335639 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:10:02.335639 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:10:02.335639 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:10:02.335639 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dce83571-cd21-48a3-b54d-b6218f563363 could not be found. Jun 22 09:10:02.335639 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:10:02.335639 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:10:02.335639 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:10:02.335639 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:10:02.335639 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:10:02.335639 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:10:02.335639 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:10:02.335639 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:10:02.335639 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dce83571-cd21-48a3-b54d-b6218f563363 could not be found. Jun 22 09:10:02.335639 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:10:02.337056 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e2ba475e-034b-43c0-8914-cb3b36d8b387 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Returning 404 to user: Instance dce83571-cd21-48a3-b54d-b6218f563363 could not be found. {{(pid=118025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:10:02.337056 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e2ba475e-034b-43c0-8914-cb3b36d8b387 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 404 len: 111 microversion: 2.20 time: 0.030316 Jun 22 09:10:02.337056 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 378/703] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:02 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 09:10:02.338717 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3a0cd94d-5bc1-4440-b2ac-1b34f4f6d251 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '.version_select at 0x7f5756238310>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:02.413014 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3a0cd94d-5bc1-4440-b2ac-1b34f4f6d251 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-489945139" status: 204 len: 0 microversion: 2.20 time: 0.078332 Jun 22 09:10:02.413576 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 326/704] 10.222.0.16 () {60 vars in 1258 bytes} [Wed Jun 22 09:10:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-489945139 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 22 09:10:03.273658 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-07981dcb-2e3d-413c-acc3-8d458964aecd tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Action: 'create', calling method: .version_select at 0x7f57561e2c10>, body: {"keypair": {"name": "tempest-keypair-1545536871", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsbQujED0MBlu5OEYYGAHjTeFtA4IClJBEhE53RA/+X1H/2G8USje7JupTPI/8eqiFCjz7cdViTu3HjeEfea8F55owWqjbESuZOWZ7qqx7e959NLavAoZyevZwpbhxN9w=="}} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:10:03.289084 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.quota [None req-07981dcb-2e3d-413c-acc3-8d458964aecd tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Getting quotas for project b172c496b3304444bd6169a09cff85d2. Resources: {'key_pairs'} {{(pid=118025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:10:03.294060 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.quota [None req-07981dcb-2e3d-413c-acc3-8d458964aecd tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Getting quotas for user dc534f42584b4e57a4706c81729cacd5 and project b172c496b3304444bd6169a09cff85d2. Resources: {'key_pairs'} {{(pid=118025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:10:03.391531 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-07981dcb-2e3d-413c-acc3-8d458964aecd tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.121832 Jun 22 09:10:03.392402 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 379/705] 10.222.0.16 () {62 vars in 1199 bytes} [Wed Jun 22 09:10:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 123 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 22 09:10:05.618780 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1f896152-de73-430b-ab65-98d6dddd0a44 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-175149226", "imageRef": "c24d36a8-7909-4174-9b12-42c8d76647ac", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "719442ce-3257-4f9d-93de-f6be967fc95d"}], "security_groups": [{"name": "tempest-securitygroup--1552519157"}], "key_name": "tempest-keypair-1545536871", "user_data": "}} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:10:05.722282 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.network.neutron [None req-1f896152-de73-430b-ab65-98d6dddd0a44 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] validate_networks() for [('719442ce-3257-4f9d-93de-f6be967fc95d', None, None, None, None, None)] {{(pid=118024) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:10:06.137261 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-1f896152-de73-430b-ab65-98d6dddd0a44 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Flavor limits 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:10:06.137694 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-1f896152-de73-430b-ab65-98d6dddd0a44 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Image limits 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:10:06.138169 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-1f896152-de73-430b-ab65-98d6dddd0a44 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Flavor pref 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:10:06.138578 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-1f896152-de73-430b-ab65-98d6dddd0a44 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Image pref 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:10:06.139009 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-1f896152-de73-430b-ab65-98d6dddd0a44 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:10:06.148042 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1f896152-de73-430b-ab65-98d6dddd0a44 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:06.148489 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1f896152-de73-430b-ab65-98d6dddd0a44 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:06.149324 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1f896152-de73-430b-ab65-98d6dddd0a44 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:06.149766 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1f896152-de73-430b-ab65-98d6dddd0a44 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:06.167322 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.quota [None req-1f896152-de73-430b-ab65-98d6dddd0a44 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Getting quotas for project b172c496b3304444bd6169a09cff85d2. Resources: {'cores', 'instances', 'ram'} {{(pid=118024) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:10:06.171764 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.quota [None req-1f896152-de73-430b-ab65-98d6dddd0a44 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Getting quotas for user dc534f42584b4e57a4706c81729cacd5 and project b172c496b3304444bd6169a09cff85d2. Resources: {'cores', 'instances', 'ram'} {{(pid=118024) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:10:06.182457 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1f896152-de73-430b-ab65-98d6dddd0a44 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Going to run 1 instances... {{(pid=118024) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:10:06.184685 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1f896152-de73-430b-ab65-98d6dddd0a44 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: 626992c9-801c-488f-98ca-253f69a7d46f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c24d36a8-7909-4174-9b12-42c8d76647ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118024) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:10:06.290257 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1f896152-de73-430b-ab65-98d6dddd0a44 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.676294 Jun 22 09:10:06.291165 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 327/706] 10.222.0.16 () {62 vars in 1187 bytes} [Wed Jun 22 09:10:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 22 09:10:06.302838 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-5bca4cdb-17f4-4bcb-9439-1b78ccffc80a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:06.303539 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-5bca4cdb-17f4-4bcb-9439-1b78ccffc80a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: 626992c9-801c-488f-98ca-253f69a7d46f] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:06.361531 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-5bca4cdb-17f4-4bcb-9439-1b78ccffc80a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:06.368764 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-5bca4cdb-17f4-4bcb-9439-1b78ccffc80a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:06.370338 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-5bca4cdb-17f4-4bcb-9439-1b78ccffc80a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:06.371550 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-5bca4cdb-17f4-4bcb-9439-1b78ccffc80a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f" status: 200 len: 1281 microversion: 2.20 time: 0.073213 Jun 22 09:10:06.372112 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 380/707] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:06 2022] GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:10:07.390449 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-75b0ae77-7b63-45ef-ba3e-edc90017995b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:07.391057 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-75b0ae77-7b63-45ef-ba3e-edc90017995b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: 626992c9-801c-488f-98ca-253f69a7d46f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:07.398411 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-75b0ae77-7b63-45ef-ba3e-edc90017995b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:07.401019 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-75b0ae77-7b63-45ef-ba3e-edc90017995b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:07.401019 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-75b0ae77-7b63-45ef-ba3e-edc90017995b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:07.401019 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-75b0ae77-7b63-45ef-ba3e-edc90017995b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:07.466294 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-75b0ae77-7b63-45ef-ba3e-edc90017995b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:07.474203 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-75b0ae77-7b63-45ef-ba3e-edc90017995b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:07.475765 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-75b0ae77-7b63-45ef-ba3e-edc90017995b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:07.476880 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-75b0ae77-7b63-45ef-ba3e-edc90017995b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f" status: 200 len: 1285 microversion: 2.20 time: 0.090684 Jun 22 09:10:07.477429 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 328/708] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:07 2022] GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f => generated 1285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:08.495510 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d028f39c-7c42-4cba-b877-86be491febb2 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:08.496911 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-d028f39c-7c42-4cba-b877-86be491febb2 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: 626992c9-801c-488f-98ca-253f69a7d46f] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:08.503536 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d028f39c-7c42-4cba-b877-86be491febb2 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:08.503980 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d028f39c-7c42-4cba-b877-86be491febb2 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:08.504738 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d028f39c-7c42-4cba-b877-86be491febb2 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:08.505202 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d028f39c-7c42-4cba-b877-86be491febb2 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:08.572474 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-d028f39c-7c42-4cba-b877-86be491febb2 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:08.581584 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-d028f39c-7c42-4cba-b877-86be491febb2 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:08.583111 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-d028f39c-7c42-4cba-b877-86be491febb2 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:08.584212 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d028f39c-7c42-4cba-b877-86be491febb2 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f" status: 200 len: 1351 microversion: 2.20 time: 0.092676 Jun 22 09:10:08.585010 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 381/709] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:08 2022] GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f => generated 1351 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:09.602125 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-461be64f-1e1a-4ab2-a213-c56de7584cc0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:09.602824 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-461be64f-1e1a-4ab2-a213-c56de7584cc0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: 626992c9-801c-488f-98ca-253f69a7d46f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:09.610023 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-461be64f-1e1a-4ab2-a213-c56de7584cc0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:09.610547 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-461be64f-1e1a-4ab2-a213-c56de7584cc0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:09.611421 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-461be64f-1e1a-4ab2-a213-c56de7584cc0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:09.611954 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-461be64f-1e1a-4ab2-a213-c56de7584cc0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:09.745460 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-461be64f-1e1a-4ab2-a213-c56de7584cc0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:09.755015 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-461be64f-1e1a-4ab2-a213-c56de7584cc0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:09.756556 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-461be64f-1e1a-4ab2-a213-c56de7584cc0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:09.757703 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-461be64f-1e1a-4ab2-a213-c56de7584cc0 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f" status: 200 len: 1407 microversion: 2.20 time: 0.159559 Jun 22 09:10:09.763464 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 329/710] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:09 2022] GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:10.175816 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-269837cd-e964-4f8b-8237-94f10c792e43 req-2a03606e-a874-4c91-8803-60865edc4a1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "626992c9-801c-488f-98ca-253f69a7d46f", "tag": "e0f42496-f468-41c2-b8b9-2e39e1f86d69"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:10:10.185312 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-269837cd-e964-4f8b-8237-94f10c792e43 req-2a03606e-a874-4c91-8803-60865edc4a1d service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:10.185756 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-269837cd-e964-4f8b-8237-94f10c792e43 req-2a03606e-a874-4c91-8803-60865edc4a1d service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:10.201671 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-269837cd-e964-4f8b-8237-94f10c792e43 req-2a03606e-a874-4c91-8803-60865edc4a1d service nova] Creating event network-changed:e0f42496-f468-41c2-b8b9-2e39e1f86d69 for instance 626992c9-801c-488f-98ca-253f69a7d46f on hv-cinder-84599 Jun 22 09:10:10.206797 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-269837cd-e964-4f8b-8237-94f10c792e43 req-2a03606e-a874-4c91-8803-60865edc4a1d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043336 Jun 22 09:10:10.207442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 382/711] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:10:10.775683 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c5a67f7b-7a3f-4198-bb7d-edf630e2bdec tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:10.776286 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c5a67f7b-7a3f-4198-bb7d-edf630e2bdec tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: 626992c9-801c-488f-98ca-253f69a7d46f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:10.783681 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c5a67f7b-7a3f-4198-bb7d-edf630e2bdec tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:10.784124 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c5a67f7b-7a3f-4198-bb7d-edf630e2bdec tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:10.784944 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c5a67f7b-7a3f-4198-bb7d-edf630e2bdec tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:10.785376 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c5a67f7b-7a3f-4198-bb7d-edf630e2bdec tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:10.920465 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-c5a67f7b-7a3f-4198-bb7d-edf630e2bdec tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:10.929120 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-c5a67f7b-7a3f-4198-bb7d-edf630e2bdec tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:10.930653 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-c5a67f7b-7a3f-4198-bb7d-edf630e2bdec tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:10.931907 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c5a67f7b-7a3f-4198-bb7d-edf630e2bdec tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f" status: 200 len: 1407 microversion: 2.20 time: 0.159994 Jun 22 09:10:10.932641 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 330/712] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:10 2022] GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:11.951208 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-234cb5e7-2687-4e2a-b68a-ec636860d22f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:11.951899 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-234cb5e7-2687-4e2a-b68a-ec636860d22f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: 626992c9-801c-488f-98ca-253f69a7d46f] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:11.958112 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-234cb5e7-2687-4e2a-b68a-ec636860d22f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:11.958557 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-234cb5e7-2687-4e2a-b68a-ec636860d22f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:11.959350 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-234cb5e7-2687-4e2a-b68a-ec636860d22f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:11.959766 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-234cb5e7-2687-4e2a-b68a-ec636860d22f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:12.094265 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-234cb5e7-2687-4e2a-b68a-ec636860d22f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:12.102759 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-234cb5e7-2687-4e2a-b68a-ec636860d22f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:12.104338 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-234cb5e7-2687-4e2a-b68a-ec636860d22f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:12.105821 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-234cb5e7-2687-4e2a-b68a-ec636860d22f tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f" status: 200 len: 1407 microversion: 2.20 time: 0.160017 Jun 22 09:10:12.106457 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 383/713] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:11 2022] GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:13.124394 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ce7bc9e7-23d5-4e43-9b8e-47f889f13dbb tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:13.125062 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ce7bc9e7-23d5-4e43-9b8e-47f889f13dbb tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: 626992c9-801c-488f-98ca-253f69a7d46f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:13.131961 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ce7bc9e7-23d5-4e43-9b8e-47f889f13dbb tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:13.132450 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ce7bc9e7-23d5-4e43-9b8e-47f889f13dbb tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:13.133341 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ce7bc9e7-23d5-4e43-9b8e-47f889f13dbb tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:13.133686 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ce7bc9e7-23d5-4e43-9b8e-47f889f13dbb tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:13.266923 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ce7bc9e7-23d5-4e43-9b8e-47f889f13dbb tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:13.274761 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ce7bc9e7-23d5-4e43-9b8e-47f889f13dbb tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:13.276265 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ce7bc9e7-23d5-4e43-9b8e-47f889f13dbb tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:13.278003 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ce7bc9e7-23d5-4e43-9b8e-47f889f13dbb tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f" status: 200 len: 1407 microversion: 2.20 time: 0.157774 Jun 22 09:10:13.278753 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 331/714] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:13 2022] GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:14.296598 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-219c44d9-e672-4048-a076-ae0f0380a8a3 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:14.297244 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-219c44d9-e672-4048-a076-ae0f0380a8a3 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: 626992c9-801c-488f-98ca-253f69a7d46f] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:14.303767 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-219c44d9-e672-4048-a076-ae0f0380a8a3 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:14.304220 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-219c44d9-e672-4048-a076-ae0f0380a8a3 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:14.305031 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-219c44d9-e672-4048-a076-ae0f0380a8a3 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:14.305473 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-219c44d9-e672-4048-a076-ae0f0380a8a3 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:14.439844 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-219c44d9-e672-4048-a076-ae0f0380a8a3 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:14.448010 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-219c44d9-e672-4048-a076-ae0f0380a8a3 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:14.450158 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-219c44d9-e672-4048-a076-ae0f0380a8a3 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:14.451288 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-219c44d9-e672-4048-a076-ae0f0380a8a3 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f" status: 200 len: 1407 microversion: 2.20 time: 0.159539 Jun 22 09:10:14.451841 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 384/715] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:14 2022] GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:15.469297 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c804c87a-25f6-4aef-a0d6-65df25decf39 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:15.470002 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c804c87a-25f6-4aef-a0d6-65df25decf39 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: 626992c9-801c-488f-98ca-253f69a7d46f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:15.476600 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c804c87a-25f6-4aef-a0d6-65df25decf39 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:15.477088 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c804c87a-25f6-4aef-a0d6-65df25decf39 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:15.477897 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c804c87a-25f6-4aef-a0d6-65df25decf39 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:15.478342 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c804c87a-25f6-4aef-a0d6-65df25decf39 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:15.613283 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-c804c87a-25f6-4aef-a0d6-65df25decf39 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:15.623217 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-c804c87a-25f6-4aef-a0d6-65df25decf39 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:15.624811 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-c804c87a-25f6-4aef-a0d6-65df25decf39 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:15.626146 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c804c87a-25f6-4aef-a0d6-65df25decf39 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f" status: 200 len: 1407 microversion: 2.20 time: 0.160762 Jun 22 09:10:15.627564 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 332/716] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:15 2022] GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:16.644112 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-418d4e26-a45c-4729-ae0e-7b7415379239 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:16.644717 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-418d4e26-a45c-4729-ae0e-7b7415379239 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: 626992c9-801c-488f-98ca-253f69a7d46f] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:16.647189 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell0:SELECT=6 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:16.652932 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-418d4e26-a45c-4729-ae0e-7b7415379239 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:16.653392 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-418d4e26-a45c-4729-ae0e-7b7415379239 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:16.654262 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-418d4e26-a45c-4729-ae0e-7b7415379239 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:16.654702 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-418d4e26-a45c-4729-ae0e-7b7415379239 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:16.788089 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-418d4e26-a45c-4729-ae0e-7b7415379239 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:16.796388 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-418d4e26-a45c-4729-ae0e-7b7415379239 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:16.797915 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-418d4e26-a45c-4729-ae0e-7b7415379239 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:16.799011 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-418d4e26-a45c-4729-ae0e-7b7415379239 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f" status: 200 len: 1407 microversion: 2.20 time: 0.158988 Jun 22 09:10:16.799561 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 385/717] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:16 2022] GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:17.678341 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [req-0f6796ca-08eb-41fa-a704-9866b064b61f req-8a288d5d-a611-4961-966b-89b9e3dc493b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "626992c9-801c-488f-98ca-253f69a7d46f", "name": "network-vif-plugged", "status": "completed", "tag": "e0f42496-f468-41c2-b8b9-2e39e1f86d69"}]} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:10:17.681870 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell0:SELECT=2 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:17.682675 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell0:SELECT=6 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:17.688393 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-0f6796ca-08eb-41fa-a704-9866b064b61f req-8a288d5d-a611-4961-966b-89b9e3dc493b service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:17.688852 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-0f6796ca-08eb-41fa-a704-9866b064b61f req-8a288d5d-a611-4961-966b-89b9e3dc493b service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:17.699843 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.compute.server_external_events [req-0f6796ca-08eb-41fa-a704-9866b064b61f req-8a288d5d-a611-4961-966b-89b9e3dc493b service nova] Creating event network-vif-plugged:e0f42496-f468-41c2-b8b9-2e39e1f86d69 for instance 626992c9-801c-488f-98ca-253f69a7d46f on hv-cinder-84599 Jun 22 09:10:17.705154 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [req-0f6796ca-08eb-41fa-a704-9866b064b61f req-8a288d5d-a611-4961-966b-89b9e3dc493b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031129 Jun 22 09:10:17.705742 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 333/718] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:10:17.817092 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d2394d0c-e34f-485a-8228-18c585555a6e tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:17.817713 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-d2394d0c-e34f-485a-8228-18c585555a6e tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: 626992c9-801c-488f-98ca-253f69a7d46f] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:17.824710 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d2394d0c-e34f-485a-8228-18c585555a6e tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:17.825689 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d2394d0c-e34f-485a-8228-18c585555a6e tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:17.825958 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d2394d0c-e34f-485a-8228-18c585555a6e tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:17.826400 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d2394d0c-e34f-485a-8228-18c585555a6e tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:17.955232 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-d2394d0c-e34f-485a-8228-18c585555a6e tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:17.964701 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-d2394d0c-e34f-485a-8228-18c585555a6e tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:17.966286 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-d2394d0c-e34f-485a-8228-18c585555a6e tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:17.967413 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d2394d0c-e34f-485a-8228-18c585555a6e tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f" status: 200 len: 1407 microversion: 2.20 time: 0.154281 Jun 22 09:10:17.967960 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 386/719] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:17 2022] GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:18.987602 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f96ac3d1-3411-4488-af78-e3564e4ca355 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:18.988333 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f96ac3d1-3411-4488-af78-e3564e4ca355 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: 626992c9-801c-488f-98ca-253f69a7d46f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:18.995790 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f96ac3d1-3411-4488-af78-e3564e4ca355 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:18.996244 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f96ac3d1-3411-4488-af78-e3564e4ca355 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:18.997052 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f96ac3d1-3411-4488-af78-e3564e4ca355 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:18.997494 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f96ac3d1-3411-4488-af78-e3564e4ca355 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:19.128533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-f96ac3d1-3411-4488-af78-e3564e4ca355 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:19.136745 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-f96ac3d1-3411-4488-af78-e3564e4ca355 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:19.138291 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-f96ac3d1-3411-4488-af78-e3564e4ca355 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:19.139391 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f96ac3d1-3411-4488-af78-e3564e4ca355 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f" status: 200 len: 1407 microversion: 2.20 time: 0.156451 Jun 22 09:10:19.139946 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 334/720] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:18 2022] GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:20.158416 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-6289b370-7dc4-4f89-8cb3-e2d40866d83a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:20.159035 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-6289b370-7dc4-4f89-8cb3-e2d40866d83a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: 626992c9-801c-488f-98ca-253f69a7d46f] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:20.165957 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6289b370-7dc4-4f89-8cb3-e2d40866d83a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:20.166405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6289b370-7dc4-4f89-8cb3-e2d40866d83a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:20.167243 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6289b370-7dc4-4f89-8cb3-e2d40866d83a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:20.167853 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6289b370-7dc4-4f89-8cb3-e2d40866d83a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:20.296939 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-6289b370-7dc4-4f89-8cb3-e2d40866d83a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:20.305009 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-6289b370-7dc4-4f89-8cb3-e2d40866d83a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:20.306530 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-6289b370-7dc4-4f89-8cb3-e2d40866d83a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:20.307680 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-6289b370-7dc4-4f89-8cb3-e2d40866d83a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f" status: 200 len: 1597 microversion: 2.20 time: 0.153432 Jun 22 09:10:20.308860 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 387/721] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:20 2022] GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f => generated 1597 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:20.327706 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b239d9b4-dfe1-45a4-b9c6-f6cc877acdda tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:20.328356 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-b239d9b4-dfe1-45a4-b9c6-f6cc877acdda tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: 626992c9-801c-488f-98ca-253f69a7d46f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:20.334346 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b239d9b4-dfe1-45a4-b9c6-f6cc877acdda tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:20.334791 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b239d9b4-dfe1-45a4-b9c6-f6cc877acdda tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:20.335551 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b239d9b4-dfe1-45a4-b9c6-f6cc877acdda tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:20.335987 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b239d9b4-dfe1-45a4-b9c6-f6cc877acdda tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:20.414494 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-b239d9b4-dfe1-45a4-b9c6-f6cc877acdda tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092254 Jun 22 09:10:20.415383 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 335/722] 10.222.0.16 () {60 vars in 1315 bytes} [Wed Jun 22 09:10:20 2022] GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 09:10:21.378805 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-548af14b-3b06-4168-985b-f8a3c3321b75 req-8ed195b8-b736-4d6b-9959-7b02ded733e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "626992c9-801c-488f-98ca-253f69a7d46f", "tag": "e0f42496-f468-41c2-b8b9-2e39e1f86d69"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:10:21.387795 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-548af14b-3b06-4168-985b-f8a3c3321b75 req-8ed195b8-b736-4d6b-9959-7b02ded733e1 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:21.388270 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-548af14b-3b06-4168-985b-f8a3c3321b75 req-8ed195b8-b736-4d6b-9959-7b02ded733e1 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:21.401247 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-548af14b-3b06-4168-985b-f8a3c3321b75 req-8ed195b8-b736-4d6b-9959-7b02ded733e1 service nova] Creating event network-changed:e0f42496-f468-41c2-b8b9-2e39e1f86d69 for instance 626992c9-801c-488f-98ca-253f69a7d46f on hv-cinder-84599 Jun 22 09:10:21.409077 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-548af14b-3b06-4168-985b-f8a3c3321b75 req-8ed195b8-b736-4d6b-9959-7b02ded733e1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034082 Jun 22 09:10:21.409982 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 388/723] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:10:33.214190 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-e0571bad-6600-4621-a267-43aedf111768 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:33.214797 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-e0571bad-6600-4621-a267-43aedf111768 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:33.218734 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:33.219491 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:33.222960 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e0571bad-6600-4621-a267-43aedf111768 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:33.223305 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e0571bad-6600-4621-a267-43aedf111768 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:33.224080 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e0571bad-6600-4621-a267-43aedf111768 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:33.224521 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e0571bad-6600-4621-a267-43aedf111768 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:33.250244 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-e0571bad-6600-4621-a267-43aedf111768 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Going to try to terminate instance {{(pid=118024) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:10:33.547669 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-e0571bad-6600-4621-a267-43aedf111768 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 204 len: 0 microversion: 2.1 time: 0.342551 Jun 22 09:10:33.548248 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 336/724] 10.222.0.16 () {58 vars in 1238 bytes} [Wed Jun 22 09:10:33 2022] DELETE /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:10:33.554194 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:33.554929 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=50 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:33.559250 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-4c0f17a1-74a0-4133-8c66-a3b5cb07a32a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:33.559976 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-4c0f17a1-74a0-4133-8c66-a3b5cb07a32a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:33.571145 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4c0f17a1-74a0-4133-8c66-a3b5cb07a32a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:33.571752 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4c0f17a1-74a0-4133-8c66-a3b5cb07a32a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:33.572365 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4c0f17a1-74a0-4133-8c66-a3b5cb07a32a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:33.573383 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4c0f17a1-74a0-4133-8c66-a3b5cb07a32a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:33.703928 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-4c0f17a1-74a0-4133-8c66-a3b5cb07a32a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:33.711234 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-4c0f17a1-74a0-4133-8c66-a3b5cb07a32a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1689 microversion: 2.1 time: 0.158690 Jun 22 09:10:33.711792 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 389/725] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:33 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:34.730059 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-eaae21c4-2be8-418a-bcdc-fd24fc7e50b4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:34.730753 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-eaae21c4-2be8-418a-bcdc-fd24fc7e50b4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:34.738169 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-eaae21c4-2be8-418a-bcdc-fd24fc7e50b4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:34.738621 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-eaae21c4-2be8-418a-bcdc-fd24fc7e50b4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:34.739381 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-eaae21c4-2be8-418a-bcdc-fd24fc7e50b4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:34.739852 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-eaae21c4-2be8-418a-bcdc-fd24fc7e50b4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:34.874181 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-eaae21c4-2be8-418a-bcdc-fd24fc7e50b4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:34.881965 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-eaae21c4-2be8-418a-bcdc-fd24fc7e50b4 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1689 microversion: 2.1 time: 0.156740 Jun 22 09:10:34.882532 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 337/726] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:34 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:35.674448 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-a7cb5c88-2d3c-4895-afcd-399ea9885780 req-294614bb-3f5e-4b79-a433-ff1cbf00cc89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcbd1c7d-a978-447a-bf3e-bc4e579e0e45", "name": "network-vif-deleted", "tag": "f2c5416a-4e17-4d7a-8b60-2e6a9f411ddd"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:10:35.686067 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-a7cb5c88-2d3c-4895-afcd-399ea9885780 req-294614bb-3f5e-4b79-a433-ff1cbf00cc89 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:35.687381 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-a7cb5c88-2d3c-4895-afcd-399ea9885780 req-294614bb-3f5e-4b79-a433-ff1cbf00cc89 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:35.697702 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-a7cb5c88-2d3c-4895-afcd-399ea9885780 req-294614bb-3f5e-4b79-a433-ff1cbf00cc89 service nova] Creating event network-vif-deleted:f2c5416a-4e17-4d7a-8b60-2e6a9f411ddd for instance bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 on hv-cinder-84599 Jun 22 09:10:35.702903 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-a7cb5c88-2d3c-4895-afcd-399ea9885780 req-294614bb-3f5e-4b79-a433-ff1cbf00cc89 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032125 Jun 22 09:10:35.703491 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 390/727] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:10:35.898743 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-e20ec9bc-96c4-4fff-bbca-c66c1260c02d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:35.899438 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-e20ec9bc-96c4-4fff-bbca-c66c1260c02d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:35.906608 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e20ec9bc-96c4-4fff-bbca-c66c1260c02d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:35.907146 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e20ec9bc-96c4-4fff-bbca-c66c1260c02d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:35.908142 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e20ec9bc-96c4-4fff-bbca-c66c1260c02d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:35.908656 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e20ec9bc-96c4-4fff-bbca-c66c1260c02d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:35.972364 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-e20ec9bc-96c4-4fff-bbca-c66c1260c02d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:35.980844 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-e20ec9bc-96c4-4fff-bbca-c66c1260c02d tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 200 len: 1330 microversion: 2.1 time: 0.085871 Jun 22 09:10:35.981444 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 338/728] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:35 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 1330 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:36.998586 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-ea3c8c68-78ed-45de-b90a-2d72146b74ec tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:36.999284 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-ea3c8c68-78ed-45de-b90a-2d72146b74ec tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: bcbd1c7d-a978-447a-bf3e-bc4e579e0e45] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:37.005580 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ea3c8c68-78ed-45de-b90a-2d72146b74ec tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:37.006026 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ea3c8c68-78ed-45de-b90a-2d72146b74ec tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:37.006837 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ea3c8c68-78ed-45de-b90a-2d72146b74ec tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:37.007274 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ea3c8c68-78ed-45de-b90a-2d72146b74ec tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:37.020887 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.wsgi [None req-ea3c8c68-78ed-45de-b90a-2d72146b74ec tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] HTTP exception thrown: Instance bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 could not be found. Jun 22 09:10:37.022462 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-ea3c8c68-78ed-45de-b90a-2d72146b74ec tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Request method failure captured: Jun 22 09:10:37.022462 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: request: GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 HTTP/1.1 Jun 22 09:10:37.022462 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept: application/json Jun 22 09:10:37.022462 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept-Encoding: identity Jun 22 09:10:37.022462 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Connection: close Jun 22 09:10:37.022462 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Length: 0 Jun 22 09:10:37.022462 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Type: application/json Jun 22 09:10:37.022462 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Host: 10.222.0.16 Jun 22 09:10:37.022462 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Openstack-System-Scope: None Jun 22 09:10:37.022462 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: User-Agent: python-urllib3/1.26.9 Jun 22 09:10:37.022462 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Auth-Token: gAAAAABistmkRR_A1SSd_DKSdmLeXfCgq8S7MTDoc5Rg_dVzj7V0Sq8HIViMmjLNjckKM4J6xg-gPY3gbXMfQytoblh_gdFPbQnFzcj16rPlrzeTOqehoqqd-eW8nblkxMTRUaTWCfvbJOUsQ24LDqfB-k6flQr9yIlEFcuMAVjS-zMIg2TYx34 Jun 22 09:10:37.022462 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Id: None Jun 22 09:10:37.022462 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Name: None Jun 22 09:10:37.022462 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Identity-Status: Confirmed Jun 22 09:10:37.022462 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Is-Admin-Project: True Jun 22 09:10:37.022462 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Id: default Jun 22 09:10:37.022462 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Name: Default Jun 22 09:10:37.022462 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Id: 4019eed8f0a140f099ca1c123ff71cef Jun 22 09:10:37.022462 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1606992120 Jun 22 09:10:37.022462 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Role: member,reader Jun 22 09:10:37.022462 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Roles: member,reader Jun 22 09:10:37.026387 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4019eed8f0a140f099ca1c123ff71cef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4019eed8f0a140f099ca1c123ff71cef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4019eed8f0a140f099ca1c123ff71cef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4019eed8f0a140f099ca1c123ff71cef", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:10:37.026387 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1606992120 Jun 22 09:10:37.026387 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Id: 4019eed8f0a140f099ca1c123ff71cef Jun 22 09:10:37.026387 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1606992120 Jun 22 09:10:37.026387 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User: tempest-ServerRescueNegativeTestJSON-1606992120-project Jun 22 09:10:37.026387 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Id: default Jun 22 09:10:37.026387 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Name: Default Jun 22 09:10:37.026387 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Id: 1a8d3cd247d743cf8c93ee15d8574602 Jun 22 09:10:37.026387 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1606992120-project Jun 22 09:10:37.026387 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: method: > Jun 22 09:10:37.026387 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: exception: Instance bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 could not be found. Jun 22 09:10:37.026387 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: action_args: {'id': 'bcbd1c7d-a978-447a-bf3e-bc4e579e0e45'} Jun 22 09:10:37.027413 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:10:37.027413 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:10:37.027413 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:10:37.027413 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:10:37.027413 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:10:37.027413 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:10:37.027413 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:10:37.027413 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:10:37.027413 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:10:37.027413 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:10:37.027413 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 could not be found. Jun 22 09:10:37.027413 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:10:37.027413 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:10:37.027413 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:10:37.027413 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:10:37.027413 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:10:37.027413 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:10:37.027413 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:10:37.027413 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:10:37.027413 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:10:37.029154 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:10:37.029154 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:10:37.029154 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:10:37.029154 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:10:37.029154 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:10:37.029154 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:10:37.029154 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:10:37.029154 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 could not be found. Jun 22 09:10:37.029154 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:10:37.029154 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:10:37.029154 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:10:37.029154 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:10:37.029154 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:10:37.029154 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:10:37.029154 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:10:37.029154 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:10:37.029154 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 could not be found. Jun 22 09:10:37.029154 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:10:37.030483 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-ea3c8c68-78ed-45de-b90a-2d72146b74ec tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Returning 404 to user: Instance bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 could not be found. {{(pid=118025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:10:37.030483 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-ea3c8c68-78ed-45de-b90a-2d72146b74ec tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45" status: 404 len: 111 microversion: 2.1 time: 0.030125 Jun 22 09:10:37.030483 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 391/729] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:36 2022] GET /compute/v2.1/servers/bcbd1c7d-a978-447a-bf3e-bc4e579e0e45 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:10:37.033165 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-348e19ed-5c00-478e-ba94-84a07ab88381 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '.version_select at 0x7f57560d0b80>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:37.104022 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-348e19ed-5c00-478e-ba94-84a07ab88381 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-324201060" status: 202 len: 0 microversion: 2.1 time: 0.074412 Jun 22 09:10:37.104723 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 339/730] 10.222.0.16 () {58 vars in 1217 bytes} [Wed Jun 22 09:10:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-324201060 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:11:10.502703 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-eebbfcc0-c95b-43cc-92d5-402c0f80d638 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:10.503192 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-eebbfcc0-c95b-43cc-92d5-402c0f80d638 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: f5dbd1b0-e21e-46fd-818b-da300c8cf1e7] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:10.508195 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=6 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:10.509473 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=10 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:10.511334 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eebbfcc0-c95b-43cc-92d5-402c0f80d638 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:10.511780 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eebbfcc0-c95b-43cc-92d5-402c0f80d638 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:10.512540 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eebbfcc0-c95b-43cc-92d5-402c0f80d638 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:10.513000 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eebbfcc0-c95b-43cc-92d5-402c0f80d638 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:10.536733 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-eebbfcc0-c95b-43cc-92d5-402c0f80d638 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7/ips" status: 200 len: 150 microversion: 2.1 time: 0.037999 Jun 22 09:11:10.537363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 392/731] 10.222.0.16 () {58 vars in 1247 bytes} [Wed Jun 22 09:11:10 2022] GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:11:37.719734 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:37.720417 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:37.724363 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c8ed8ff1-198b-4497-af22-da4823cb7fc8 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:37.724918 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c8ed8ff1-198b-4497-af22-da4823cb7fc8 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: 626992c9-801c-488f-98ca-253f69a7d46f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:37.731485 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c8ed8ff1-198b-4497-af22-da4823cb7fc8 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:37.731935 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c8ed8ff1-198b-4497-af22-da4823cb7fc8 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:37.732702 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c8ed8ff1-198b-4497-af22-da4823cb7fc8 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:37.733168 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c8ed8ff1-198b-4497-af22-da4823cb7fc8 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:37.756852 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c8ed8ff1-198b-4497-af22-da4823cb7fc8 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f/ips" status: 200 len: 149 microversion: 2.20 time: 0.038739 Jun 22 09:11:37.757568 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 340/732] 10.222.0.16 () {60 vars in 1288 bytes} [Wed Jun 22 09:11:37 2022] GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 09:11:39.165241 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:11:39.165783 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Wed Jun 22 09:11:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:11:56.441079 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e190f378-25d7-43ff-a045-0e2d295ddd8e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:56.442016 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e190f378-25d7-43ff-a045-0e2d295ddd8e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:56.449211 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e190f378-25d7-43ff-a045-0e2d295ddd8e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:56.449672 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e190f378-25d7-43ff-a045-0e2d295ddd8e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:56.450455 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e190f378-25d7-43ff-a045-0e2d295ddd8e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:56.450898 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e190f378-25d7-43ff-a045-0e2d295ddd8e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:56.481359 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e190f378-25d7-43ff-a045-0e2d295ddd8e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044974 Jun 22 09:11:56.481912 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 393/733] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:11:56 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:11:57.493925 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-02ff54ff-3a4b-418d-b421-7fe589a5b913 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:57.495044 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-02ff54ff-3a4b-418d-b421-7fe589a5b913 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:57.502490 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-02ff54ff-3a4b-418d-b421-7fe589a5b913 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:57.502942 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-02ff54ff-3a4b-418d-b421-7fe589a5b913 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:57.503699 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-02ff54ff-3a4b-418d-b421-7fe589a5b913 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:57.504130 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-02ff54ff-3a4b-418d-b421-7fe589a5b913 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:57.536412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-02ff54ff-3a4b-418d-b421-7fe589a5b913 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047047 Jun 22 09:11:57.536976 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 341/734] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:11:57 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:11:58.548326 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9e732ae4-198a-4d1a-95e5-b997a88438bf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:58.549204 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9e732ae4-198a-4d1a-95e5-b997a88438bf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:58.556974 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9e732ae4-198a-4d1a-95e5-b997a88438bf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:58.557442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9e732ae4-198a-4d1a-95e5-b997a88438bf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:58.558208 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9e732ae4-198a-4d1a-95e5-b997a88438bf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:58.558646 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9e732ae4-198a-4d1a-95e5-b997a88438bf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:58.587858 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9e732ae4-198a-4d1a-95e5-b997a88438bf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043547 Jun 22 09:11:58.588389 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 394/735] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:11:58 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:11:59.599458 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-13b253f5-8f9b-460f-9dec-b7b757f53a84 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:59.600413 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-13b253f5-8f9b-460f-9dec-b7b757f53a84 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:59.609138 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-13b253f5-8f9b-460f-9dec-b7b757f53a84 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:59.609593 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-13b253f5-8f9b-460f-9dec-b7b757f53a84 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:59.610353 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-13b253f5-8f9b-460f-9dec-b7b757f53a84 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:59.610829 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-13b253f5-8f9b-460f-9dec-b7b757f53a84 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:59.642510 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-13b253f5-8f9b-460f-9dec-b7b757f53a84 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047276 Jun 22 09:11:59.643053 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 342/736] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:11:59 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:00.665191 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c24f37ab-f2a5-42db-9cb8-b08cced65789 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:00.666135 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c24f37ab-f2a5-42db-9cb8-b08cced65789 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:00.672632 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c24f37ab-f2a5-42db-9cb8-b08cced65789 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:00.673122 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c24f37ab-f2a5-42db-9cb8-b08cced65789 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:00.673900 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c24f37ab-f2a5-42db-9cb8-b08cced65789 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:00.674334 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c24f37ab-f2a5-42db-9cb8-b08cced65789 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:00.704140 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c24f37ab-f2a5-42db-9cb8-b08cced65789 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043207 Jun 22 09:12:00.704680 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 395/737] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:00 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:01.715469 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6f89d779-1af3-43cf-bc79-ae7ec1f9e316 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:01.716404 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-6f89d779-1af3-43cf-bc79-ae7ec1f9e316 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:01.723050 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6f89d779-1af3-43cf-bc79-ae7ec1f9e316 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:01.723502 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6f89d779-1af3-43cf-bc79-ae7ec1f9e316 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:01.724261 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6f89d779-1af3-43cf-bc79-ae7ec1f9e316 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:01.724698 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6f89d779-1af3-43cf-bc79-ae7ec1f9e316 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:01.754015 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-6f89d779-1af3-43cf-bc79-ae7ec1f9e316 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042464 Jun 22 09:12:01.754551 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 343/738] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:01 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:02.765795 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-17a7465b-951a-477f-add3-427a485e130e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:02.766720 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-17a7465b-951a-477f-add3-427a485e130e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:02.773182 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-17a7465b-951a-477f-add3-427a485e130e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:02.773630 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-17a7465b-951a-477f-add3-427a485e130e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:02.774467 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-17a7465b-951a-477f-add3-427a485e130e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:02.774977 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-17a7465b-951a-477f-add3-427a485e130e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:02.802983 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-17a7465b-951a-477f-add3-427a485e130e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041081 Jun 22 09:12:02.803445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 396/739] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:02 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:03.815001 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f2049e0a-31f2-4278-b4be-6e3d862dde0a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:03.815923 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f2049e0a-31f2-4278-b4be-6e3d862dde0a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:03.822994 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f2049e0a-31f2-4278-b4be-6e3d862dde0a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:03.823443 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f2049e0a-31f2-4278-b4be-6e3d862dde0a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:03.824211 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f2049e0a-31f2-4278-b4be-6e3d862dde0a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:03.824647 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f2049e0a-31f2-4278-b4be-6e3d862dde0a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:03.853494 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f2049e0a-31f2-4278-b4be-6e3d862dde0a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042304 Jun 22 09:12:03.854035 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 344/740] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:03 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:04.864950 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e3527b6d-e4f7-4846-9a2a-0ea8be56a895 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:04.865868 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e3527b6d-e4f7-4846-9a2a-0ea8be56a895 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:04.872309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e3527b6d-e4f7-4846-9a2a-0ea8be56a895 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:04.872758 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e3527b6d-e4f7-4846-9a2a-0ea8be56a895 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:04.873544 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e3527b6d-e4f7-4846-9a2a-0ea8be56a895 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:04.873979 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e3527b6d-e4f7-4846-9a2a-0ea8be56a895 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:04.903591 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e3527b6d-e4f7-4846-9a2a-0ea8be56a895 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042520 Jun 22 09:12:04.904128 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 397/741] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:04 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:05.915235 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a8fcb87c-6044-43f9-9833-a5d2e82495ed tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:05.916181 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a8fcb87c-6044-43f9-9833-a5d2e82495ed tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:05.922576 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a8fcb87c-6044-43f9-9833-a5d2e82495ed tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:05.923024 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a8fcb87c-6044-43f9-9833-a5d2e82495ed tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:05.923779 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a8fcb87c-6044-43f9-9833-a5d2e82495ed tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:05.924213 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a8fcb87c-6044-43f9-9833-a5d2e82495ed tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:05.953337 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a8fcb87c-6044-43f9-9833-a5d2e82495ed tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042353 Jun 22 09:12:05.953869 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 345/742] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:05 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:12:06.964802 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-b7a3e22f-ee49-45d7-bf32-2a2940076567 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:06.965854 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-b7a3e22f-ee49-45d7-bf32-2a2940076567 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:06.972407 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b7a3e22f-ee49-45d7-bf32-2a2940076567 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:06.972899 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b7a3e22f-ee49-45d7-bf32-2a2940076567 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:06.973668 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b7a3e22f-ee49-45d7-bf32-2a2940076567 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:06.974105 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b7a3e22f-ee49-45d7-bf32-2a2940076567 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:07.005169 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-b7a3e22f-ee49-45d7-bf32-2a2940076567 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044444 Jun 22 09:12:07.005755 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 398/743] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:06 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:08.017131 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b69f442b-6e05-4df2-9a7b-dae3f3226618 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:08.018077 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-b69f442b-6e05-4df2-9a7b-dae3f3226618 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:08.024492 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b69f442b-6e05-4df2-9a7b-dae3f3226618 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:08.024979 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b69f442b-6e05-4df2-9a7b-dae3f3226618 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:08.025803 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b69f442b-6e05-4df2-9a7b-dae3f3226618 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:08.026387 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b69f442b-6e05-4df2-9a7b-dae3f3226618 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:08.054602 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-b69f442b-6e05-4df2-9a7b-dae3f3226618 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041444 Jun 22 09:12:08.055159 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 346/744] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:08 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:09.066476 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-824c3cfd-519c-4e33-a999-35c6c71f9fc6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:09.067426 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-824c3cfd-519c-4e33-a999-35c6c71f9fc6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:09.074737 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-824c3cfd-519c-4e33-a999-35c6c71f9fc6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:09.075190 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-824c3cfd-519c-4e33-a999-35c6c71f9fc6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:09.075954 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-824c3cfd-519c-4e33-a999-35c6c71f9fc6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:09.076390 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-824c3cfd-519c-4e33-a999-35c6c71f9fc6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:09.105548 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-824c3cfd-519c-4e33-a999-35c6c71f9fc6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043045 Jun 22 09:12:09.106082 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 399/745] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:09 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:10.117084 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-471268e3-3261-4122-b504-597e14eb1b6c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:10.118033 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-471268e3-3261-4122-b504-597e14eb1b6c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:10.125103 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-471268e3-3261-4122-b504-597e14eb1b6c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:10.125545 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-471268e3-3261-4122-b504-597e14eb1b6c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:10.126303 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-471268e3-3261-4122-b504-597e14eb1b6c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:10.126735 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-471268e3-3261-4122-b504-597e14eb1b6c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:10.154776 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-471268e3-3261-4122-b504-597e14eb1b6c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041646 Jun 22 09:12:10.155315 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 347/746] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:10 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:12:11.167450 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-4907d718-1953-4e18-b2b2-cceb19c97f27 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:11.168391 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-4907d718-1953-4e18-b2b2-cceb19c97f27 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:11.175239 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4907d718-1953-4e18-b2b2-cceb19c97f27 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:11.175698 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4907d718-1953-4e18-b2b2-cceb19c97f27 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:11.176575 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4907d718-1953-4e18-b2b2-cceb19c97f27 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:11.177043 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4907d718-1953-4e18-b2b2-cceb19c97f27 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:11.209345 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-4907d718-1953-4e18-b2b2-cceb19c97f27 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046777 Jun 22 09:12:11.209912 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 400/747] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:11 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:12.221665 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-97829ed4-26da-48d4-82de-1ea5a597a102 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:12.222595 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-97829ed4-26da-48d4-82de-1ea5a597a102 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:12.229183 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-97829ed4-26da-48d4-82de-1ea5a597a102 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:12.229636 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-97829ed4-26da-48d4-82de-1ea5a597a102 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:12.230405 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-97829ed4-26da-48d4-82de-1ea5a597a102 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:12.230843 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-97829ed4-26da-48d4-82de-1ea5a597a102 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:12.258856 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-97829ed4-26da-48d4-82de-1ea5a597a102 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041255 Jun 22 09:12:12.259396 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 348/748] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:12 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:13.270643 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-672f2a60-139c-45d7-806b-8ab52f0ac56a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:13.271565 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-672f2a60-139c-45d7-806b-8ab52f0ac56a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:13.278475 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-672f2a60-139c-45d7-806b-8ab52f0ac56a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:13.278926 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-672f2a60-139c-45d7-806b-8ab52f0ac56a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:13.279683 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-672f2a60-139c-45d7-806b-8ab52f0ac56a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:13.280124 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-672f2a60-139c-45d7-806b-8ab52f0ac56a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:13.309886 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-672f2a60-139c-45d7-806b-8ab52f0ac56a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043124 Jun 22 09:12:13.310424 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 401/749] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:13 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:14.321314 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-42b9e004-b993-45e1-ba3b-357c93265656 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:14.322871 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-42b9e004-b993-45e1-ba3b-357c93265656 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:14.331113 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-42b9e004-b993-45e1-ba3b-357c93265656 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:14.331562 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-42b9e004-b993-45e1-ba3b-357c93265656 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:14.332367 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-42b9e004-b993-45e1-ba3b-357c93265656 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:14.332822 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-42b9e004-b993-45e1-ba3b-357c93265656 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:14.363186 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-42b9e004-b993-45e1-ba3b-357c93265656 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045714 Jun 22 09:12:14.363744 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 349/750] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:14 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:15.375184 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-26f54916-73fd-47da-90f3-9c3d18ef5c16 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:15.376235 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-26f54916-73fd-47da-90f3-9c3d18ef5c16 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:15.382775 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-26f54916-73fd-47da-90f3-9c3d18ef5c16 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:15.383226 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-26f54916-73fd-47da-90f3-9c3d18ef5c16 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:15.383995 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-26f54916-73fd-47da-90f3-9c3d18ef5c16 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:15.384435 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-26f54916-73fd-47da-90f3-9c3d18ef5c16 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:15.415242 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-26f54916-73fd-47da-90f3-9c3d18ef5c16 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044042 Jun 22 09:12:15.416688 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 402/751] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:15 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:16.427954 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-e6a5dedf-450b-41fe-8027-8ed546268b78 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:16.428915 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-e6a5dedf-450b-41fe-8027-8ed546268b78 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:16.436773 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e6a5dedf-450b-41fe-8027-8ed546268b78 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:16.437249 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e6a5dedf-450b-41fe-8027-8ed546268b78 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:16.438008 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e6a5dedf-450b-41fe-8027-8ed546268b78 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:16.438444 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e6a5dedf-450b-41fe-8027-8ed546268b78 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:16.467230 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-e6a5dedf-450b-41fe-8027-8ed546268b78 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043866 Jun 22 09:12:16.467704 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 350/752] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:16 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:17.479060 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-31a129fe-a0f9-4765-a8ff-201b39f21eb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:17.480021 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-31a129fe-a0f9-4765-a8ff-201b39f21eb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:17.486633 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-31a129fe-a0f9-4765-a8ff-201b39f21eb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:17.487088 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-31a129fe-a0f9-4765-a8ff-201b39f21eb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:17.487855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-31a129fe-a0f9-4765-a8ff-201b39f21eb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:17.488297 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-31a129fe-a0f9-4765-a8ff-201b39f21eb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:17.517081 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-31a129fe-a0f9-4765-a8ff-201b39f21eb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042514 Jun 22 09:12:17.517569 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 403/753] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:17 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:18.529732 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c5e5afaa-17bc-46a2-b40f-95c5f2fa6671 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:18.530669 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c5e5afaa-17bc-46a2-b40f-95c5f2fa6671 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:18.537688 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c5e5afaa-17bc-46a2-b40f-95c5f2fa6671 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:18.538137 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c5e5afaa-17bc-46a2-b40f-95c5f2fa6671 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:18.538898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c5e5afaa-17bc-46a2-b40f-95c5f2fa6671 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:18.539341 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c5e5afaa-17bc-46a2-b40f-95c5f2fa6671 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:18.568115 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c5e5afaa-17bc-46a2-b40f-95c5f2fa6671 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043404 Jun 22 09:12:18.568658 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 351/754] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:18 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:19.580262 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-8b4b8b72-521d-4454-a1fc-1d22acc09830 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:19.581238 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-8b4b8b72-521d-4454-a1fc-1d22acc09830 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:19.588862 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8b4b8b72-521d-4454-a1fc-1d22acc09830 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:19.589315 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8b4b8b72-521d-4454-a1fc-1d22acc09830 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:19.590095 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8b4b8b72-521d-4454-a1fc-1d22acc09830 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:19.590531 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8b4b8b72-521d-4454-a1fc-1d22acc09830 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:19.623112 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-8b4b8b72-521d-4454-a1fc-1d22acc09830 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046787 Jun 22 09:12:19.623706 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 404/755] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:19 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:12:20.634148 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-79efb366-317e-4cf4-b1a0-6441a0a1fe47 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:20.635096 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-79efb366-317e-4cf4-b1a0-6441a0a1fe47 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:20.641367 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-79efb366-317e-4cf4-b1a0-6441a0a1fe47 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:20.641807 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-79efb366-317e-4cf4-b1a0-6441a0a1fe47 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:20.642556 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-79efb366-317e-4cf4-b1a0-6441a0a1fe47 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:20.642990 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-79efb366-317e-4cf4-b1a0-6441a0a1fe47 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:20.672611 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-79efb366-317e-4cf4-b1a0-6441a0a1fe47 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042423 Jun 22 09:12:20.673182 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 352/756] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:20 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:21.684309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-1e8f1361-cb35-4a58-847a-bc20e9b5a988 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:21.685243 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-1e8f1361-cb35-4a58-847a-bc20e9b5a988 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:21.691192 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1e8f1361-cb35-4a58-847a-bc20e9b5a988 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:21.691637 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1e8f1361-cb35-4a58-847a-bc20e9b5a988 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:21.692392 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1e8f1361-cb35-4a58-847a-bc20e9b5a988 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:21.692859 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1e8f1361-cb35-4a58-847a-bc20e9b5a988 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:21.721529 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-1e8f1361-cb35-4a58-847a-bc20e9b5a988 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041305 Jun 22 09:12:21.722070 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 405/757] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:21 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:22.732260 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-50aecf1a-f6fe-4406-9e50-1a3256c756a0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:22.733212 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-50aecf1a-f6fe-4406-9e50-1a3256c756a0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:22.739625 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-50aecf1a-f6fe-4406-9e50-1a3256c756a0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:22.740077 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-50aecf1a-f6fe-4406-9e50-1a3256c756a0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:22.740869 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-50aecf1a-f6fe-4406-9e50-1a3256c756a0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:22.741313 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-50aecf1a-f6fe-4406-9e50-1a3256c756a0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:22.769647 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-50aecf1a-f6fe-4406-9e50-1a3256c756a0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041378 Jun 22 09:12:22.770198 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 353/758] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:22 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:12:23.781318 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-aa2f19c4-c5ba-4a52-9a88-3a91c6de37b3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:23.782239 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-aa2f19c4-c5ba-4a52-9a88-3a91c6de37b3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:23.788920 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-aa2f19c4-c5ba-4a52-9a88-3a91c6de37b3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:23.789367 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-aa2f19c4-c5ba-4a52-9a88-3a91c6de37b3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:23.790193 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-aa2f19c4-c5ba-4a52-9a88-3a91c6de37b3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:23.790633 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-aa2f19c4-c5ba-4a52-9a88-3a91c6de37b3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:23.818828 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-aa2f19c4-c5ba-4a52-9a88-3a91c6de37b3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041758 Jun 22 09:12:23.819359 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 406/759] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:23 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:24.830268 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-9114bbb3-aee0-46fe-8444-0fa82df0531a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:24.831203 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-9114bbb3-aee0-46fe-8444-0fa82df0531a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:24.837737 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9114bbb3-aee0-46fe-8444-0fa82df0531a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:24.838188 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9114bbb3-aee0-46fe-8444-0fa82df0531a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:24.838942 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9114bbb3-aee0-46fe-8444-0fa82df0531a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:24.839435 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9114bbb3-aee0-46fe-8444-0fa82df0531a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:24.868800 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-9114bbb3-aee0-46fe-8444-0fa82df0531a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042421 Jun 22 09:12:24.869359 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 354/760] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:24 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:25.880845 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7df72777-6bbe-4aa8-aaef-cbc4a093bf63 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:25.881769 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7df72777-6bbe-4aa8-aaef-cbc4a093bf63 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:25.888905 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7df72777-6bbe-4aa8-aaef-cbc4a093bf63 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:25.889354 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7df72777-6bbe-4aa8-aaef-cbc4a093bf63 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:25.890115 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7df72777-6bbe-4aa8-aaef-cbc4a093bf63 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:25.890547 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7df72777-6bbe-4aa8-aaef-cbc4a093bf63 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:25.919500 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7df72777-6bbe-4aa8-aaef-cbc4a093bf63 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042569 Jun 22 09:12:25.920029 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 407/761] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:25 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:26.930840 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-02af8246-5678-46a3-8c07-0e095383e6c0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:26.931765 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-02af8246-5678-46a3-8c07-0e095383e6c0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:26.938847 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-02af8246-5678-46a3-8c07-0e095383e6c0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:26.939296 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-02af8246-5678-46a3-8c07-0e095383e6c0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:26.940056 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-02af8246-5678-46a3-8c07-0e095383e6c0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:26.940490 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-02af8246-5678-46a3-8c07-0e095383e6c0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:26.971025 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-02af8246-5678-46a3-8c07-0e095383e6c0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044039 Jun 22 09:12:26.971969 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 355/762] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:26 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:27.982595 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-125df10c-a076-4121-a0d3-7d735990033e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:27.983591 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-125df10c-a076-4121-a0d3-7d735990033e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:27.986080 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=33 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:27.990835 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-125df10c-a076-4121-a0d3-7d735990033e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:27.991279 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-125df10c-a076-4121-a0d3-7d735990033e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:27.992044 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-125df10c-a076-4121-a0d3-7d735990033e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:27.992482 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-125df10c-a076-4121-a0d3-7d735990033e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:27.996756 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=95 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:28.021686 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-125df10c-a076-4121-a0d3-7d735990033e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043755 Jun 22 09:12:28.022236 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 408/763] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:27 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:29.033806 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a85438f3-2615-4371-b903-2d8fb0b100b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:29.034999 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a85438f3-2615-4371-b903-2d8fb0b100b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:29.041699 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a85438f3-2615-4371-b903-2d8fb0b100b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:29.042150 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a85438f3-2615-4371-b903-2d8fb0b100b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:29.044065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a85438f3-2615-4371-b903-2d8fb0b100b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:29.044515 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a85438f3-2615-4371-b903-2d8fb0b100b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:29.069143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=100 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:29.074239 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a85438f3-2615-4371-b903-2d8fb0b100b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044068 Jun 22 09:12:29.074801 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 356/764] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:29 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:30.085987 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-3cda35de-34e7-4291-b16a-119290dbb1e8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:30.086918 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-3cda35de-34e7-4291-b16a-119290dbb1e8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:30.094305 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3cda35de-34e7-4291-b16a-119290dbb1e8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:30.094754 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3cda35de-34e7-4291-b16a-119290dbb1e8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:30.095520 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3cda35de-34e7-4291-b16a-119290dbb1e8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:30.095959 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3cda35de-34e7-4291-b16a-119290dbb1e8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:30.123992 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-3cda35de-34e7-4291-b16a-119290dbb1e8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042521 Jun 22 09:12:30.124537 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 409/765] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:30 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:31.135499 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-52419a15-2b37-4535-96a3-5da1b2bfa858 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:31.137171 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-52419a15-2b37-4535-96a3-5da1b2bfa858 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:31.143938 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-52419a15-2b37-4535-96a3-5da1b2bfa858 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:31.144385 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-52419a15-2b37-4535-96a3-5da1b2bfa858 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:31.145169 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-52419a15-2b37-4535-96a3-5da1b2bfa858 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:31.145605 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-52419a15-2b37-4535-96a3-5da1b2bfa858 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:31.174689 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-52419a15-2b37-4535-96a3-5da1b2bfa858 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043180 Jun 22 09:12:31.175238 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 357/766] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:31 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:32.186717 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-ee12b680-60b8-40b8-81ee-a4ceb0f55ef5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:32.187649 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-ee12b680-60b8-40b8-81ee-a4ceb0f55ef5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:32.194222 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ee12b680-60b8-40b8-81ee-a4ceb0f55ef5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:32.194683 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ee12b680-60b8-40b8-81ee-a4ceb0f55ef5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:32.195460 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ee12b680-60b8-40b8-81ee-a4ceb0f55ef5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:32.195901 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ee12b680-60b8-40b8-81ee-a4ceb0f55ef5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:32.225920 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-ee12b680-60b8-40b8-81ee-a4ceb0f55ef5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043693 Jun 22 09:12:32.226475 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 410/767] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:32 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:33.238221 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c961b429-9c7b-450d-a76c-f35b4b7599e2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:33.239468 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c961b429-9c7b-450d-a76c-f35b4b7599e2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:33.241758 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=37 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:33.246478 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c961b429-9c7b-450d-a76c-f35b4b7599e2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:33.246925 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c961b429-9c7b-450d-a76c-f35b4b7599e2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:33.247680 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c961b429-9c7b-450d-a76c-f35b4b7599e2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:33.248114 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c961b429-9c7b-450d-a76c-f35b4b7599e2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:33.276377 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c961b429-9c7b-450d-a76c-f35b4b7599e2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042071 Jun 22 09:12:33.279448 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 358/768] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:33 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:34.289236 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-dbe32828-c6c5-403c-9785-0be422edbe07 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:34.290159 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-dbe32828-c6c5-403c-9785-0be422edbe07 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:34.297230 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dbe32828-c6c5-403c-9785-0be422edbe07 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:34.297676 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dbe32828-c6c5-403c-9785-0be422edbe07 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:34.298456 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dbe32828-c6c5-403c-9785-0be422edbe07 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:34.298888 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dbe32828-c6c5-403c-9785-0be422edbe07 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:34.326483 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-dbe32828-c6c5-403c-9785-0be422edbe07 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041191 Jun 22 09:12:34.327016 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 411/769] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:34 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:35.338265 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a712dd59-54d9-48cf-bdc8-a20393abe19a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:35.339167 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a712dd59-54d9-48cf-bdc8-a20393abe19a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:35.346314 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a712dd59-54d9-48cf-bdc8-a20393abe19a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:35.346769 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a712dd59-54d9-48cf-bdc8-a20393abe19a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:35.347573 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a712dd59-54d9-48cf-bdc8-a20393abe19a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:35.348016 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a712dd59-54d9-48cf-bdc8-a20393abe19a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:35.381048 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a712dd59-54d9-48cf-bdc8-a20393abe19a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047127 Jun 22 09:12:35.381643 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 359/770] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:35 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:36.392536 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f7a96996-a884-487f-9b74-038f1bf6b4a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:36.393496 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-f7a96996-a884-487f-9b74-038f1bf6b4a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:36.399858 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f7a96996-a884-487f-9b74-038f1bf6b4a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:36.400301 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f7a96996-a884-487f-9b74-038f1bf6b4a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:36.401073 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f7a96996-a884-487f-9b74-038f1bf6b4a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:36.402000 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f7a96996-a884-487f-9b74-038f1bf6b4a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:36.431593 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f7a96996-a884-487f-9b74-038f1bf6b4a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042941 Jun 22 09:12:36.432149 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 412/771] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:36 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:37.443034 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-769cd100-f043-4cc2-a23b-243de249cc6d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:37.443959 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-769cd100-f043-4cc2-a23b-243de249cc6d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:37.450456 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-769cd100-f043-4cc2-a23b-243de249cc6d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:37.450914 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-769cd100-f043-4cc2-a23b-243de249cc6d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:37.451682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-769cd100-f043-4cc2-a23b-243de249cc6d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:37.452125 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-769cd100-f043-4cc2-a23b-243de249cc6d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:37.481423 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-769cd100-f043-4cc2-a23b-243de249cc6d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042418 Jun 22 09:12:37.481965 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 360/772] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:37 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:38.493012 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-ca4af0d4-c35c-4e34-9d15-3765018772cf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:38.494122 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-ca4af0d4-c35c-4e34-9d15-3765018772cf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:38.501737 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ca4af0d4-c35c-4e34-9d15-3765018772cf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:38.502196 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ca4af0d4-c35c-4e34-9d15-3765018772cf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:38.502962 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ca4af0d4-c35c-4e34-9d15-3765018772cf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:38.503403 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ca4af0d4-c35c-4e34-9d15-3765018772cf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:38.532237 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-ca4af0d4-c35c-4e34-9d15-3765018772cf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043182 Jun 22 09:12:38.532786 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 413/773] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:38 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:39.543994 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b4cce66c-dc4a-41f3-adef-bd124069e86e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:39.544943 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-b4cce66c-dc4a-41f3-adef-bd124069e86e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:39.551433 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b4cce66c-dc4a-41f3-adef-bd124069e86e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:39.551881 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b4cce66c-dc4a-41f3-adef-bd124069e86e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:39.552634 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b4cce66c-dc4a-41f3-adef-bd124069e86e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:39.553097 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b4cce66c-dc4a-41f3-adef-bd124069e86e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:39.582657 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-b4cce66c-dc4a-41f3-adef-bd124069e86e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042650 Jun 22 09:12:39.583209 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 361/774] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:39 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:40.594680 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-1797fca9-6064-4bc3-bfbe-b784c2d97db6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:40.595607 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-1797fca9-6064-4bc3-bfbe-b784c2d97db6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:40.602022 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1797fca9-6064-4bc3-bfbe-b784c2d97db6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:40.602473 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1797fca9-6064-4bc3-bfbe-b784c2d97db6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:40.603232 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1797fca9-6064-4bc3-bfbe-b784c2d97db6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:40.603669 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1797fca9-6064-4bc3-bfbe-b784c2d97db6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:40.632496 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-1797fca9-6064-4bc3-bfbe-b784c2d97db6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041774 Jun 22 09:12:40.633082 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 414/775] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:40 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:41.645062 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-77fe0e1a-454c-45b6-a077-1851ab88c035 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:41.646012 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-77fe0e1a-454c-45b6-a077-1851ab88c035 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:41.653057 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-77fe0e1a-454c-45b6-a077-1851ab88c035 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:41.653504 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-77fe0e1a-454c-45b6-a077-1851ab88c035 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:41.654259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-77fe0e1a-454c-45b6-a077-1851ab88c035 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:41.654694 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-77fe0e1a-454c-45b6-a077-1851ab88c035 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:41.683166 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-77fe0e1a-454c-45b6-a077-1851ab88c035 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041529 Jun 22 09:12:41.683595 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 362/776] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:41 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:42.693950 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-3ff9f53e-bcb9-4c19-9b56-f5c255863d4f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:42.694880 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-3ff9f53e-bcb9-4c19-9b56-f5c255863d4f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:42.702663 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3ff9f53e-bcb9-4c19-9b56-f5c255863d4f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:42.703118 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3ff9f53e-bcb9-4c19-9b56-f5c255863d4f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:42.703878 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3ff9f53e-bcb9-4c19-9b56-f5c255863d4f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:42.704318 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3ff9f53e-bcb9-4c19-9b56-f5c255863d4f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:42.732720 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-3ff9f53e-bcb9-4c19-9b56-f5c255863d4f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042744 Jun 22 09:12:42.733289 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 415/777] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:42 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:43.743275 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-22ebea28-ecaa-43da-856e-655d0fbb7252 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:43.744250 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-22ebea28-ecaa-43da-856e-655d0fbb7252 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:43.751194 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-22ebea28-ecaa-43da-856e-655d0fbb7252 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:43.751648 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-22ebea28-ecaa-43da-856e-655d0fbb7252 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:43.752413 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-22ebea28-ecaa-43da-856e-655d0fbb7252 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:43.752882 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-22ebea28-ecaa-43da-856e-655d0fbb7252 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:43.783009 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-22ebea28-ecaa-43da-856e-655d0fbb7252 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043728 Jun 22 09:12:43.783557 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 363/778] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:43 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:44.795500 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a793bdcc-3f6e-430c-a234-6c9125de1434 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:44.796424 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-a793bdcc-3f6e-430c-a234-6c9125de1434 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:44.803194 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a793bdcc-3f6e-430c-a234-6c9125de1434 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:44.803654 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a793bdcc-3f6e-430c-a234-6c9125de1434 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:44.804413 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a793bdcc-3f6e-430c-a234-6c9125de1434 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:44.804876 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a793bdcc-3f6e-430c-a234-6c9125de1434 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:44.832772 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a793bdcc-3f6e-430c-a234-6c9125de1434 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041924 Jun 22 09:12:44.833332 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 416/779] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:44 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:45.844148 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a454aeb4-33f6-45c8-b949-e5b897361a51 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:45.845113 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a454aeb4-33f6-45c8-b949-e5b897361a51 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:45.851654 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a454aeb4-33f6-45c8-b949-e5b897361a51 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:45.852111 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a454aeb4-33f6-45c8-b949-e5b897361a51 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:45.852907 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a454aeb4-33f6-45c8-b949-e5b897361a51 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:45.853355 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a454aeb4-33f6-45c8-b949-e5b897361a51 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:45.884051 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a454aeb4-33f6-45c8-b949-e5b897361a51 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043750 Jun 22 09:12:45.884607 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 364/780] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:45 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:46.895368 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-26e7fa4a-3933-4767-aea3-84b258f9fa61 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:46.896298 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-26e7fa4a-3933-4767-aea3-84b258f9fa61 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:46.908235 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-26e7fa4a-3933-4767-aea3-84b258f9fa61 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:46.908690 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-26e7fa4a-3933-4767-aea3-84b258f9fa61 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:46.909749 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-26e7fa4a-3933-4767-aea3-84b258f9fa61 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:46.910195 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-26e7fa4a-3933-4767-aea3-84b258f9fa61 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:46.938980 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-26e7fa4a-3933-4767-aea3-84b258f9fa61 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047647 Jun 22 09:12:46.939510 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 417/781] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:46 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:47.951040 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-5c4d6e13-9571-4aa2-8437-6173b5440fa6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:47.951973 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-5c4d6e13-9571-4aa2-8437-6173b5440fa6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:47.958414 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5c4d6e13-9571-4aa2-8437-6173b5440fa6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:47.958872 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5c4d6e13-9571-4aa2-8437-6173b5440fa6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:47.959852 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5c4d6e13-9571-4aa2-8437-6173b5440fa6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:47.960298 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5c4d6e13-9571-4aa2-8437-6173b5440fa6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:47.992365 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-5c4d6e13-9571-4aa2-8437-6173b5440fa6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045836 Jun 22 09:12:47.992952 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 365/782] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:47 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:49.004388 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-1312ed1f-e39d-41c3-b49f-24b785d37e10 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:49.005342 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-1312ed1f-e39d-41c3-b49f-24b785d37e10 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:49.012481 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1312ed1f-e39d-41c3-b49f-24b785d37e10 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:49.012966 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1312ed1f-e39d-41c3-b49f-24b785d37e10 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:49.013735 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1312ed1f-e39d-41c3-b49f-24b785d37e10 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:49.014175 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1312ed1f-e39d-41c3-b49f-24b785d37e10 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:49.043427 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-1312ed1f-e39d-41c3-b49f-24b785d37e10 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042685 Jun 22 09:12:49.047124 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 418/783] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:48 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:50.054960 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-8b386242-d1b5-49c8-96f8-f7628d14d64f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:50.055912 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-8b386242-d1b5-49c8-96f8-f7628d14d64f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:50.062587 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8b386242-d1b5-49c8-96f8-f7628d14d64f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:50.063039 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8b386242-d1b5-49c8-96f8-f7628d14d64f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:50.063809 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8b386242-d1b5-49c8-96f8-f7628d14d64f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:50.064252 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8b386242-d1b5-49c8-96f8-f7628d14d64f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:50.094218 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-8b386242-d1b5-49c8-96f8-f7628d14d64f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043273 Jun 22 09:12:50.094792 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 366/784] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:50 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:51.105877 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-b286532e-893d-497c-be46-7c2f3e9a1129 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:51.106833 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-b286532e-893d-497c-be46-7c2f3e9a1129 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:51.113274 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b286532e-893d-497c-be46-7c2f3e9a1129 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:51.113721 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b286532e-893d-497c-be46-7c2f3e9a1129 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:51.114471 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b286532e-893d-497c-be46-7c2f3e9a1129 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:51.114906 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b286532e-893d-497c-be46-7c2f3e9a1129 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:51.144494 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-b286532e-893d-497c-be46-7c2f3e9a1129 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043227 Jun 22 09:12:51.145076 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 419/785] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:51 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:52.156006 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-92db5936-ee77-4fc0-a0ef-69e4618c413d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:52.157067 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-92db5936-ee77-4fc0-a0ef-69e4618c413d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:52.164092 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-92db5936-ee77-4fc0-a0ef-69e4618c413d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:52.164566 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-92db5936-ee77-4fc0-a0ef-69e4618c413d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:52.165341 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-92db5936-ee77-4fc0-a0ef-69e4618c413d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:52.165777 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-92db5936-ee77-4fc0-a0ef-69e4618c413d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:52.196365 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-92db5936-ee77-4fc0-a0ef-69e4618c413d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044232 Jun 22 09:12:52.196961 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 367/786] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:52 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:53.208137 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-344cfe42-2b83-46c9-922b-91f3ba0a8d59 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:53.209095 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-344cfe42-2b83-46c9-922b-91f3ba0a8d59 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:53.215405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-344cfe42-2b83-46c9-922b-91f3ba0a8d59 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:53.215521 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-344cfe42-2b83-46c9-922b-91f3ba0a8d59 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:53.216258 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-344cfe42-2b83-46c9-922b-91f3ba0a8d59 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:53.216689 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-344cfe42-2b83-46c9-922b-91f3ba0a8d59 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:53.246719 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-344cfe42-2b83-46c9-922b-91f3ba0a8d59 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041985 Jun 22 09:12:53.247283 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 420/787] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:53 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:54.258272 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3405df35-e4b7-4265-b9ec-b88c6117d697 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:54.259197 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3405df35-e4b7-4265-b9ec-b88c6117d697 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:54.266161 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3405df35-e4b7-4265-b9ec-b88c6117d697 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:54.266603 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3405df35-e4b7-4265-b9ec-b88c6117d697 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:54.267353 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3405df35-e4b7-4265-b9ec-b88c6117d697 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:54.267783 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3405df35-e4b7-4265-b9ec-b88c6117d697 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:54.298084 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3405df35-e4b7-4265-b9ec-b88c6117d697 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043670 Jun 22 09:12:54.298643 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 368/788] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:54 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:55.309615 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-361b1560-8cd4-4d8b-aec8-8f37c0fd4a18 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:55.310540 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-361b1560-8cd4-4d8b-aec8-8f37c0fd4a18 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:55.317003 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-361b1560-8cd4-4d8b-aec8-8f37c0fd4a18 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:55.317449 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-361b1560-8cd4-4d8b-aec8-8f37c0fd4a18 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:55.318205 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-361b1560-8cd4-4d8b-aec8-8f37c0fd4a18 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:55.318642 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-361b1560-8cd4-4d8b-aec8-8f37c0fd4a18 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:55.348171 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-361b1560-8cd4-4d8b-aec8-8f37c0fd4a18 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042574 Jun 22 09:12:55.348726 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 421/789] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:55 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:56.360492 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-2bd97054-0f49-4beb-a303-ee899523d38f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:56.361469 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-2bd97054-0f49-4beb-a303-ee899523d38f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:56.368013 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2bd97054-0f49-4beb-a303-ee899523d38f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:56.368462 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2bd97054-0f49-4beb-a303-ee899523d38f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:56.369252 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2bd97054-0f49-4beb-a303-ee899523d38f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:56.369693 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2bd97054-0f49-4beb-a303-ee899523d38f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:56.399729 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-2bd97054-0f49-4beb-a303-ee899523d38f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043145 Jun 22 09:12:56.400294 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 369/790] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:56 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:57.411515 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-b9cce84e-403c-4844-ad7d-f2ab06e56652 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:57.412432 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-b9cce84e-403c-4844-ad7d-f2ab06e56652 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:57.419078 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b9cce84e-403c-4844-ad7d-f2ab06e56652 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:57.419535 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b9cce84e-403c-4844-ad7d-f2ab06e56652 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:57.420267 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b9cce84e-403c-4844-ad7d-f2ab06e56652 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:57.420702 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b9cce84e-403c-4844-ad7d-f2ab06e56652 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:57.451168 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-b9cce84e-403c-4844-ad7d-f2ab06e56652 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043804 Jun 22 09:12:57.451728 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 422/791] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:57 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:58.462701 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3fa7c0fe-fe99-4a04-97c0-a3decdbbaa93 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:58.464856 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3fa7c0fe-fe99-4a04-97c0-a3decdbbaa93 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:58.474951 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3fa7c0fe-fe99-4a04-97c0-a3decdbbaa93 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:58.474951 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3fa7c0fe-fe99-4a04-97c0-a3decdbbaa93 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:58.474951 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3fa7c0fe-fe99-4a04-97c0-a3decdbbaa93 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:58.474951 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3fa7c0fe-fe99-4a04-97c0-a3decdbbaa93 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:58.503797 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3fa7c0fe-fe99-4a04-97c0-a3decdbbaa93 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045357 Jun 22 09:12:58.508996 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 370/792] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:58 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:59.514859 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-187f0930-746b-4ed1-b023-984e04c91e12 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:59.515807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-187f0930-746b-4ed1-b023-984e04c91e12 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:59.522402 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-187f0930-746b-4ed1-b023-984e04c91e12 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:59.522842 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-187f0930-746b-4ed1-b023-984e04c91e12 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:59.523585 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-187f0930-746b-4ed1-b023-984e04c91e12 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:59.524019 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-187f0930-746b-4ed1-b023-984e04c91e12 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:59.553290 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-187f0930-746b-4ed1-b023-984e04c91e12 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042328 Jun 22 09:12:59.553802 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 423/793] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:59 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:00.565533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a357790b-65d6-47d4-827c-d226585f5240 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:00.567417 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a357790b-65d6-47d4-827c-d226585f5240 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:00.573248 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a357790b-65d6-47d4-827c-d226585f5240 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:00.573704 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a357790b-65d6-47d4-827c-d226585f5240 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:00.575167 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a357790b-65d6-47d4-827c-d226585f5240 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:00.575657 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a357790b-65d6-47d4-827c-d226585f5240 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:00.604913 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a357790b-65d6-47d4-827c-d226585f5240 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043498 Jun 22 09:13:00.605762 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 371/794] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:00 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:01.616550 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-95ad8d97-f412-4c77-80b6-74e70333c94f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:01.617506 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-95ad8d97-f412-4c77-80b6-74e70333c94f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:01.619912 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=32 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:01.624718 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-95ad8d97-f412-4c77-80b6-74e70333c94f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:01.633465 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-95ad8d97-f412-4c77-80b6-74e70333c94f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:01.633465 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-95ad8d97-f412-4c77-80b6-74e70333c94f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:01.633465 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-95ad8d97-f412-4c77-80b6-74e70333c94f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:01.633465 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=96 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:01.662088 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-95ad8d97-f412-4c77-80b6-74e70333c94f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046972 Jun 22 09:13:01.662088 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 424/795] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:01 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:02.671864 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c89d6c0e-ad96-4be6-8a4a-196bcc87afd8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:02.672813 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c89d6c0e-ad96-4be6-8a4a-196bcc87afd8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:02.679284 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c89d6c0e-ad96-4be6-8a4a-196bcc87afd8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:02.679738 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c89d6c0e-ad96-4be6-8a4a-196bcc87afd8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:02.680585 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c89d6c0e-ad96-4be6-8a4a-196bcc87afd8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:02.680966 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c89d6c0e-ad96-4be6-8a4a-196bcc87afd8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:02.684753 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=91 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:02.713441 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c89d6c0e-ad96-4be6-8a4a-196bcc87afd8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046064 Jun 22 09:13:02.714003 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 372/796] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:02 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:03.730093 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d6eb7751-53c4-4de8-b044-b0c5990ddeb2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:03.731525 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-d6eb7751-53c4-4de8-b044-b0c5990ddeb2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:03.738048 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d6eb7751-53c4-4de8-b044-b0c5990ddeb2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:03.738499 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d6eb7751-53c4-4de8-b044-b0c5990ddeb2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:03.739260 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d6eb7751-53c4-4de8-b044-b0c5990ddeb2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:03.739694 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d6eb7751-53c4-4de8-b044-b0c5990ddeb2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:03.769568 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d6eb7751-53c4-4de8-b044-b0c5990ddeb2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043735 Jun 22 09:13:03.770137 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 425/797] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:03 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:04.781606 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-74da2ece-b473-4344-b74c-8b6ae4f22e14 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:04.782561 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-74da2ece-b473-4344-b74c-8b6ae4f22e14 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:04.789358 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-74da2ece-b473-4344-b74c-8b6ae4f22e14 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:04.789811 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-74da2ece-b473-4344-b74c-8b6ae4f22e14 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:04.790574 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-74da2ece-b473-4344-b74c-8b6ae4f22e14 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:04.791016 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-74da2ece-b473-4344-b74c-8b6ae4f22e14 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:04.826566 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-74da2ece-b473-4344-b74c-8b6ae4f22e14 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049456 Jun 22 09:13:04.827132 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 373/798] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:04 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:05.838218 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-830144fa-6957-4723-b113-806b16124659 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:05.839019 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-830144fa-6957-4723-b113-806b16124659 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:05.845645 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-830144fa-6957-4723-b113-806b16124659 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:05.846096 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-830144fa-6957-4723-b113-806b16124659 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:05.846862 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-830144fa-6957-4723-b113-806b16124659 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:05.847317 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-830144fa-6957-4723-b113-806b16124659 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:05.877101 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-830144fa-6957-4723-b113-806b16124659 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042918 Jun 22 09:13:05.877665 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 426/799] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:05 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:06.888636 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-906b154b-b399-4277-9c17-32dbf7490cd5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:06.889594 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-906b154b-b399-4277-9c17-32dbf7490cd5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:06.891922 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=32 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:06.896668 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-906b154b-b399-4277-9c17-32dbf7490cd5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:06.897156 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-906b154b-b399-4277-9c17-32dbf7490cd5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:06.897928 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-906b154b-b399-4277-9c17-32dbf7490cd5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:06.898369 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-906b154b-b399-4277-9c17-32dbf7490cd5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:06.929504 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-906b154b-b399-4277-9c17-32dbf7490cd5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044989 Jun 22 09:13:06.931881 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 374/800] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:06 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:07.940961 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-fd1a4686-0fdd-47f6-b27c-951c9accb59a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:07.941916 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-fd1a4686-0fdd-47f6-b27c-951c9accb59a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:07.948397 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fd1a4686-0fdd-47f6-b27c-951c9accb59a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:07.949591 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fd1a4686-0fdd-47f6-b27c-951c9accb59a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:07.950306 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fd1a4686-0fdd-47f6-b27c-951c9accb59a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:07.950740 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fd1a4686-0fdd-47f6-b27c-951c9accb59a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:07.979853 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-fd1a4686-0fdd-47f6-b27c-951c9accb59a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042791 Jun 22 09:13:07.981055 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 427/801] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:07 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:08.991921 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-241a82c0-6e28-4d38-baf8-4a950ed7443c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:08.993596 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-241a82c0-6e28-4d38-baf8-4a950ed7443c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:08.999946 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-241a82c0-6e28-4d38-baf8-4a950ed7443c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:09.000406 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-241a82c0-6e28-4d38-baf8-4a950ed7443c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:09.001205 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-241a82c0-6e28-4d38-baf8-4a950ed7443c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:09.001645 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-241a82c0-6e28-4d38-baf8-4a950ed7443c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:09.031633 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-241a82c0-6e28-4d38-baf8-4a950ed7443c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044035 Jun 22 09:13:09.032190 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 375/802] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:08 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:13:10.042855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f4e857a8-8960-40c1-acae-cc8355a82da7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:10.044364 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-f4e857a8-8960-40c1-acae-cc8355a82da7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:10.051296 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f4e857a8-8960-40c1-acae-cc8355a82da7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:10.051741 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f4e857a8-8960-40c1-acae-cc8355a82da7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:10.052532 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f4e857a8-8960-40c1-acae-cc8355a82da7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:10.053019 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f4e857a8-8960-40c1-acae-cc8355a82da7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:10.082520 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f4e857a8-8960-40c1-acae-cc8355a82da7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043755 Jun 22 09:13:10.083230 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 428/803] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:10 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:11.095977 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-bc2bbcba-87af-4e97-be65-57c35d1eb054 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:11.098441 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-bc2bbcba-87af-4e97-be65-57c35d1eb054 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:11.105227 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bc2bbcba-87af-4e97-be65-57c35d1eb054 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:11.105676 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bc2bbcba-87af-4e97-be65-57c35d1eb054 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:11.106471 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bc2bbcba-87af-4e97-be65-57c35d1eb054 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:11.107115 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bc2bbcba-87af-4e97-be65-57c35d1eb054 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:11.145842 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-bc2bbcba-87af-4e97-be65-57c35d1eb054 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053057 Jun 22 09:13:11.145842 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 376/804] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:11 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:12.155332 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-4300852e-a6a8-44e7-8f1d-f27d6a3f941c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:12.156284 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-4300852e-a6a8-44e7-8f1d-f27d6a3f941c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:12.163062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4300852e-a6a8-44e7-8f1d-f27d6a3f941c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:12.163514 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4300852e-a6a8-44e7-8f1d-f27d6a3f941c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:12.164284 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4300852e-a6a8-44e7-8f1d-f27d6a3f941c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:12.164725 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4300852e-a6a8-44e7-8f1d-f27d6a3f941c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:12.196725 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-4300852e-a6a8-44e7-8f1d-f27d6a3f941c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043999 Jun 22 09:13:12.200619 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 429/805] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:12 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:13.289449 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:13:13.290055 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Wed Jun 22 09:13:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:13:13.349767 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-38ed24d8-be7e-4148-a1b6-ea8041b0380b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:13.350740 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-38ed24d8-be7e-4148-a1b6-ea8041b0380b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:13.356680 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-38ed24d8-be7e-4148-a1b6-ea8041b0380b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:13.357151 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-38ed24d8-be7e-4148-a1b6-ea8041b0380b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:13.357903 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-38ed24d8-be7e-4148-a1b6-ea8041b0380b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:13.358335 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-38ed24d8-be7e-4148-a1b6-ea8041b0380b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:13.388076 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-38ed24d8-be7e-4148-a1b6-ea8041b0380b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.183517 Jun 22 09:13:13.388630 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 377/806] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:13 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:14.400718 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e70151ce-073d-49bc-985f-f462d3a8c964 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:14.401671 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e70151ce-073d-49bc-985f-f462d3a8c964 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:14.408538 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e70151ce-073d-49bc-985f-f462d3a8c964 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:14.409018 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e70151ce-073d-49bc-985f-f462d3a8c964 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:14.409824 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e70151ce-073d-49bc-985f-f462d3a8c964 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:14.410259 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e70151ce-073d-49bc-985f-f462d3a8c964 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:14.442553 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e70151ce-073d-49bc-985f-f462d3a8c964 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046867 Jun 22 09:13:14.443018 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 430/807] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:14 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:15.453910 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ff81cf5e-7005-4ccd-906d-e84c87c6f240 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:15.454834 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ff81cf5e-7005-4ccd-906d-e84c87c6f240 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:15.461269 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ff81cf5e-7005-4ccd-906d-e84c87c6f240 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:15.461713 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ff81cf5e-7005-4ccd-906d-e84c87c6f240 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:15.462464 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ff81cf5e-7005-4ccd-906d-e84c87c6f240 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:15.462898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ff81cf5e-7005-4ccd-906d-e84c87c6f240 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:15.491291 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ff81cf5e-7005-4ccd-906d-e84c87c6f240 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041918 Jun 22 09:13:15.491842 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 378/808] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:15 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:16.502210 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-5c995072-6480-4976-8ea0-b3192530d501 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:16.503069 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-5c995072-6480-4976-8ea0-b3192530d501 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:16.509749 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5c995072-6480-4976-8ea0-b3192530d501 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:16.510199 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5c995072-6480-4976-8ea0-b3192530d501 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:16.510956 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5c995072-6480-4976-8ea0-b3192530d501 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:16.511391 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5c995072-6480-4976-8ea0-b3192530d501 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:16.540680 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-5c995072-6480-4976-8ea0-b3192530d501 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042592 Jun 22 09:13:16.541250 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 431/809] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:16 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:17.086277 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:13:17.086778 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Wed Jun 22 09:13:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:13:17.552139 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f538cc7e-8cf5-40de-bed4-e713c814f3d1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:17.553082 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f538cc7e-8cf5-40de-bed4-e713c814f3d1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:17.560437 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f538cc7e-8cf5-40de-bed4-e713c814f3d1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:17.560912 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f538cc7e-8cf5-40de-bed4-e713c814f3d1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:17.561670 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f538cc7e-8cf5-40de-bed4-e713c814f3d1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:17.562102 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f538cc7e-8cf5-40de-bed4-e713c814f3d1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:17.590770 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f538cc7e-8cf5-40de-bed4-e713c814f3d1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041987 Jun 22 09:13:17.591311 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 379/810] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:17 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:18.602064 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-93e4e745-8f7c-4754-b938-65247cd869b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:18.602985 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-93e4e745-8f7c-4754-b938-65247cd869b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:18.610094 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-93e4e745-8f7c-4754-b938-65247cd869b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:18.612299 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-93e4e745-8f7c-4754-b938-65247cd869b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:18.613109 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-93e4e745-8f7c-4754-b938-65247cd869b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:18.613551 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-93e4e745-8f7c-4754-b938-65247cd869b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:18.649888 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-93e4e745-8f7c-4754-b938-65247cd869b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051660 Jun 22 09:13:18.650431 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 432/811] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:18 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:19.663352 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a7229136-c7f3-4d07-a4ce-963bd23b9c88 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:19.664272 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a7229136-c7f3-4d07-a4ce-963bd23b9c88 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:19.670651 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a7229136-c7f3-4d07-a4ce-963bd23b9c88 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:19.671097 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a7229136-c7f3-4d07-a4ce-963bd23b9c88 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:19.671848 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a7229136-c7f3-4d07-a4ce-963bd23b9c88 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:19.672283 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a7229136-c7f3-4d07-a4ce-963bd23b9c88 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:19.700698 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a7229136-c7f3-4d07-a4ce-963bd23b9c88 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041326 Jun 22 09:13:19.701457 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 380/812] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:19 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:20.711666 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-bc10804f-f156-454d-ac97-9b4cb7a3d95d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:20.712584 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-bc10804f-f156-454d-ac97-9b4cb7a3d95d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:20.720247 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bc10804f-f156-454d-ac97-9b4cb7a3d95d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:20.720701 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bc10804f-f156-454d-ac97-9b4cb7a3d95d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:20.721500 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bc10804f-f156-454d-ac97-9b4cb7a3d95d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:20.721946 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bc10804f-f156-454d-ac97-9b4cb7a3d95d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:20.751811 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-bc10804f-f156-454d-ac97-9b4cb7a3d95d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044266 Jun 22 09:13:20.752353 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 433/813] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:20 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:21.764361 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-526e8f3a-132d-4a52-892e-a7858f509482 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:21.765335 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-526e8f3a-132d-4a52-892e-a7858f509482 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:21.771703 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-526e8f3a-132d-4a52-892e-a7858f509482 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:21.772149 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-526e8f3a-132d-4a52-892e-a7858f509482 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:21.772931 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-526e8f3a-132d-4a52-892e-a7858f509482 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:21.773369 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-526e8f3a-132d-4a52-892e-a7858f509482 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:21.802665 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-526e8f3a-132d-4a52-892e-a7858f509482 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043184 Jun 22 09:13:21.803215 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 381/814] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:21 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:22.815353 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a587ff27-2a3b-43ec-bb75-18c2dc79d57e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:22.816617 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-a587ff27-2a3b-43ec-bb75-18c2dc79d57e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:22.822916 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a587ff27-2a3b-43ec-bb75-18c2dc79d57e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:22.823372 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a587ff27-2a3b-43ec-bb75-18c2dc79d57e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:22.824147 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a587ff27-2a3b-43ec-bb75-18c2dc79d57e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:22.826095 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a587ff27-2a3b-43ec-bb75-18c2dc79d57e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:22.855553 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a587ff27-2a3b-43ec-bb75-18c2dc79d57e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044525 Jun 22 09:13:22.859919 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 434/815] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:22 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:23.868226 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-91495f5e-79ad-47e0-9826-d4520b39178a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:23.869823 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-91495f5e-79ad-47e0-9826-d4520b39178a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:23.876881 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-91495f5e-79ad-47e0-9826-d4520b39178a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:23.877335 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-91495f5e-79ad-47e0-9826-d4520b39178a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:23.878103 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-91495f5e-79ad-47e0-9826-d4520b39178a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:23.878541 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-91495f5e-79ad-47e0-9826-d4520b39178a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:23.908067 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-91495f5e-79ad-47e0-9826-d4520b39178a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044358 Jun 22 09:13:23.908612 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 382/816] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:23 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:24.919284 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c8d67c1d-1b8b-484b-a286-62dfcc81a619 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:24.920202 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c8d67c1d-1b8b-484b-a286-62dfcc81a619 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:24.926745 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c8d67c1d-1b8b-484b-a286-62dfcc81a619 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:24.927410 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c8d67c1d-1b8b-484b-a286-62dfcc81a619 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:24.928329 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c8d67c1d-1b8b-484b-a286-62dfcc81a619 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:24.929218 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c8d67c1d-1b8b-484b-a286-62dfcc81a619 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:24.959869 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c8d67c1d-1b8b-484b-a286-62dfcc81a619 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044471 Jun 22 09:13:24.960419 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 435/817] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:24 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:25.973076 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-9320abce-4f48-45d1-92cf-e90bdd55750d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:25.974093 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-9320abce-4f48-45d1-92cf-e90bdd55750d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:25.980459 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9320abce-4f48-45d1-92cf-e90bdd55750d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:25.980945 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9320abce-4f48-45d1-92cf-e90bdd55750d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:25.981717 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9320abce-4f48-45d1-92cf-e90bdd55750d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:25.982153 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9320abce-4f48-45d1-92cf-e90bdd55750d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:26.012248 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-9320abce-4f48-45d1-92cf-e90bdd55750d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043091 Jun 22 09:13:26.013462 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 383/818] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:25 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:27.032057 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-3ef5b239-aeb4-4583-84bc-f34df3310d8f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:27.032057 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-3ef5b239-aeb4-4583-84bc-f34df3310d8f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:27.032865 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3ef5b239-aeb4-4583-84bc-f34df3310d8f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:27.033132 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3ef5b239-aeb4-4583-84bc-f34df3310d8f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:27.033895 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3ef5b239-aeb4-4583-84bc-f34df3310d8f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:27.034330 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3ef5b239-aeb4-4583-84bc-f34df3310d8f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:27.065006 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-3ef5b239-aeb4-4583-84bc-f34df3310d8f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044542 Jun 22 09:13:27.065556 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 436/819] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:27 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:28.076518 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-486d23d8-c08c-428e-b64d-9fa4f6160aca tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:28.077515 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-486d23d8-c08c-428e-b64d-9fa4f6160aca tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:28.083944 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-486d23d8-c08c-428e-b64d-9fa4f6160aca tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:28.084395 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-486d23d8-c08c-428e-b64d-9fa4f6160aca tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:28.085192 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-486d23d8-c08c-428e-b64d-9fa4f6160aca tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:28.085636 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-486d23d8-c08c-428e-b64d-9fa4f6160aca tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:28.116050 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-486d23d8-c08c-428e-b64d-9fa4f6160aca tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043378 Jun 22 09:13:28.116617 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 384/820] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:28 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:29.128387 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c12c1ac0-2bf0-42ae-ab38-d4477b9b2d80 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:29.129389 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c12c1ac0-2bf0-42ae-ab38-d4477b9b2d80 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:29.136120 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c12c1ac0-2bf0-42ae-ab38-d4477b9b2d80 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:29.136583 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c12c1ac0-2bf0-42ae-ab38-d4477b9b2d80 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:29.138434 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c12c1ac0-2bf0-42ae-ab38-d4477b9b2d80 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:29.138925 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c12c1ac0-2bf0-42ae-ab38-d4477b9b2d80 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:29.171285 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c12c1ac0-2bf0-42ae-ab38-d4477b9b2d80 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046790 Jun 22 09:13:29.171856 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 437/821] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:29 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:30.182738 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-504a6384-59d0-4524-b0a1-46ce2c360617 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:30.185280 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-504a6384-59d0-4524-b0a1-46ce2c360617 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:30.195385 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-504a6384-59d0-4524-b0a1-46ce2c360617 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:30.195385 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-504a6384-59d0-4524-b0a1-46ce2c360617 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:30.195385 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-504a6384-59d0-4524-b0a1-46ce2c360617 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:30.195385 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-504a6384-59d0-4524-b0a1-46ce2c360617 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:30.221996 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-504a6384-59d0-4524-b0a1-46ce2c360617 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043151 Jun 22 09:13:30.222571 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 385/822] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:30 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:31.233642 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-b8eb0ba9-bcb3-4acb-8e07-f6faa2aa29d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:31.234640 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-b8eb0ba9-bcb3-4acb-8e07-f6faa2aa29d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:31.241255 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b8eb0ba9-bcb3-4acb-8e07-f6faa2aa29d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:31.241705 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b8eb0ba9-bcb3-4acb-8e07-f6faa2aa29d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:31.242565 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b8eb0ba9-bcb3-4acb-8e07-f6faa2aa29d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:31.243007 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b8eb0ba9-bcb3-4acb-8e07-f6faa2aa29d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:31.272541 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-b8eb0ba9-bcb3-4acb-8e07-f6faa2aa29d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042910 Jun 22 09:13:31.273323 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 438/823] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:31 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:32.284225 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-d15284ca-e130-41ad-9cbd-84d3418f2f9f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:32.285235 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-d15284ca-e130-41ad-9cbd-84d3418f2f9f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:32.291827 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d15284ca-e130-41ad-9cbd-84d3418f2f9f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:32.292204 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d15284ca-e130-41ad-9cbd-84d3418f2f9f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:32.293626 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d15284ca-e130-41ad-9cbd-84d3418f2f9f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:32.294478 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d15284ca-e130-41ad-9cbd-84d3418f2f9f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:32.323372 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-d15284ca-e130-41ad-9cbd-84d3418f2f9f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043270 Jun 22 09:13:32.323933 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 386/824] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:32 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:33.335055 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c443b1d6-93a3-443e-b5eb-707b912a99e0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:33.335978 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c443b1d6-93a3-443e-b5eb-707b912a99e0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:33.339438 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=30 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:33.344322 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c443b1d6-93a3-443e-b5eb-707b912a99e0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:33.344800 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c443b1d6-93a3-443e-b5eb-707b912a99e0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:33.345581 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c443b1d6-93a3-443e-b5eb-707b912a99e0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:33.346208 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c443b1d6-93a3-443e-b5eb-707b912a99e0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:33.377134 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c443b1d6-93a3-443e-b5eb-707b912a99e0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045976 Jun 22 09:13:33.381754 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 439/825] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:33 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:34.389462 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a086545a-16bc-437c-ae20-412d7e25dfe5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:34.390417 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a086545a-16bc-437c-ae20-412d7e25dfe5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:34.396961 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a086545a-16bc-437c-ae20-412d7e25dfe5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:34.397430 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a086545a-16bc-437c-ae20-412d7e25dfe5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:34.398241 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a086545a-16bc-437c-ae20-412d7e25dfe5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:34.398698 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a086545a-16bc-437c-ae20-412d7e25dfe5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:34.429453 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a086545a-16bc-437c-ae20-412d7e25dfe5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044543 Jun 22 09:13:34.430000 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 387/826] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:34 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:35.441472 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-bffb438f-a370-405a-bf12-554d30d906d2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:35.442439 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-bffb438f-a370-405a-bf12-554d30d906d2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:35.448888 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bffb438f-a370-405a-bf12-554d30d906d2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:35.449343 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bffb438f-a370-405a-bf12-554d30d906d2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:35.450118 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bffb438f-a370-405a-bf12-554d30d906d2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:35.450557 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bffb438f-a370-405a-bf12-554d30d906d2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:35.454227 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=96 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:35.479282 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-bffb438f-a370-405a-bf12-554d30d906d2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041903 Jun 22 09:13:35.479969 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 440/827] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:35 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:36.491352 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-dc7681ed-d16a-4909-92d1-38ce17c867d3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:36.492322 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-dc7681ed-d16a-4909-92d1-38ce17c867d3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:36.499913 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dc7681ed-d16a-4909-92d1-38ce17c867d3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:36.500368 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dc7681ed-d16a-4909-92d1-38ce17c867d3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:36.501172 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dc7681ed-d16a-4909-92d1-38ce17c867d3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:36.501614 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dc7681ed-d16a-4909-92d1-38ce17c867d3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:36.504021 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=96 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:36.532999 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-dc7681ed-d16a-4909-92d1-38ce17c867d3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045710 Jun 22 09:13:36.533561 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 388/828] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:36 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:37.543530 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-12502a5d-bf37-4825-bb49-12854d6c2c6c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:37.544604 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-12502a5d-bf37-4825-bb49-12854d6c2c6c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:37.551330 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-12502a5d-bf37-4825-bb49-12854d6c2c6c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:37.551790 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-12502a5d-bf37-4825-bb49-12854d6c2c6c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:37.552560 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-12502a5d-bf37-4825-bb49-12854d6c2c6c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:37.553031 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-12502a5d-bf37-4825-bb49-12854d6c2c6c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:37.583701 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-12502a5d-bf37-4825-bb49-12854d6c2c6c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044077 Jun 22 09:13:37.584254 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 441/829] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:37 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:37.588560 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:13:37.589057 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Wed Jun 22 09:13:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:13:38.596025 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-d9d6cf0d-6b0a-4238-acfc-c20c2a06d1db tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:38.596992 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-d9d6cf0d-6b0a-4238-acfc-c20c2a06d1db tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:38.603874 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d9d6cf0d-6b0a-4238-acfc-c20c2a06d1db tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:38.604323 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d9d6cf0d-6b0a-4238-acfc-c20c2a06d1db tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:38.605137 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d9d6cf0d-6b0a-4238-acfc-c20c2a06d1db tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:38.605592 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d9d6cf0d-6b0a-4238-acfc-c20c2a06d1db tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:38.636703 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-d9d6cf0d-6b0a-4238-acfc-c20c2a06d1db tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046157 Jun 22 09:13:38.637947 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 389/830] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:38 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:39.648871 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-374590d7-d775-4b47-b240-5bc452262971 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:39.655718 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-374590d7-d775-4b47-b240-5bc452262971 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:39.657070 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-374590d7-d775-4b47-b240-5bc452262971 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:39.657524 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-374590d7-d775-4b47-b240-5bc452262971 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:39.658281 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-374590d7-d775-4b47-b240-5bc452262971 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:39.658717 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-374590d7-d775-4b47-b240-5bc452262971 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:39.687533 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-374590d7-d775-4b47-b240-5bc452262971 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042687 Jun 22 09:13:39.688094 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 442/831] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:39 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:39.764958 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:13:39.765124 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Wed Jun 22 09:13:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:13:40.699040 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6002ac3c-4b60-494f-9779-b24eda2b4cbc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:40.700652 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-6002ac3c-4b60-494f-9779-b24eda2b4cbc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:40.702965 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=32 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:40.707903 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6002ac3c-4b60-494f-9779-b24eda2b4cbc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:40.708345 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6002ac3c-4b60-494f-9779-b24eda2b4cbc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:40.709164 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6002ac3c-4b60-494f-9779-b24eda2b4cbc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:40.713973 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6002ac3c-4b60-494f-9779-b24eda2b4cbc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:40.740393 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-6002ac3c-4b60-494f-9779-b24eda2b4cbc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045185 Jun 22 09:13:40.740900 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 390/832] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:40 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:41.751801 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9dde20e7-071b-41a6-89a5-1fd39058abc9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:41.752831 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9dde20e7-071b-41a6-89a5-1fd39058abc9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:41.759475 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9dde20e7-071b-41a6-89a5-1fd39058abc9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:41.759924 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9dde20e7-071b-41a6-89a5-1fd39058abc9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:41.760689 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9dde20e7-071b-41a6-89a5-1fd39058abc9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:41.761150 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9dde20e7-071b-41a6-89a5-1fd39058abc9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:41.790994 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9dde20e7-071b-41a6-89a5-1fd39058abc9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043104 Jun 22 09:13:41.791537 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 443/833] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:41 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:42.803669 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-08033497-5dd7-43fa-b522-4c9bb7749474 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:42.804653 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-08033497-5dd7-43fa-b522-4c9bb7749474 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:42.811648 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-08033497-5dd7-43fa-b522-4c9bb7749474 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:42.812100 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-08033497-5dd7-43fa-b522-4c9bb7749474 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:42.812898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-08033497-5dd7-43fa-b522-4c9bb7749474 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:42.813336 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-08033497-5dd7-43fa-b522-4c9bb7749474 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:42.843116 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-08033497-5dd7-43fa-b522-4c9bb7749474 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043374 Jun 22 09:13:42.843675 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 391/834] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:42 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:43.857361 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-6559a6c5-3c24-49ec-a8f7-f36e2b1546ed tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:43.858301 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-6559a6c5-3c24-49ec-a8f7-f36e2b1546ed tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:43.864840 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6559a6c5-3c24-49ec-a8f7-f36e2b1546ed tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:43.865304 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6559a6c5-3c24-49ec-a8f7-f36e2b1546ed tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:43.866081 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6559a6c5-3c24-49ec-a8f7-f36e2b1546ed tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:43.866525 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6559a6c5-3c24-49ec-a8f7-f36e2b1546ed tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:43.896021 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-6559a6c5-3c24-49ec-a8f7-f36e2b1546ed tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045159 Jun 22 09:13:43.896491 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 444/835] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:43 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:44.908255 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-8b0c99fa-a1a8-4ae7-8a02-883330a782e3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:44.909214 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-8b0c99fa-a1a8-4ae7-8a02-883330a782e3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:44.915588 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8b0c99fa-a1a8-4ae7-8a02-883330a782e3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:44.916037 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8b0c99fa-a1a8-4ae7-8a02-883330a782e3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:44.916807 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8b0c99fa-a1a8-4ae7-8a02-883330a782e3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:44.917250 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8b0c99fa-a1a8-4ae7-8a02-883330a782e3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:44.945569 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-8b0c99fa-a1a8-4ae7-8a02-883330a782e3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041447 Jun 22 09:13:44.946237 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 392/836] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:44 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:45.956717 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-1b026c3e-3671-4efc-9c92-557952797330 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:45.957888 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-1b026c3e-3671-4efc-9c92-557952797330 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:45.964828 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1b026c3e-3671-4efc-9c92-557952797330 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:45.965281 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1b026c3e-3671-4efc-9c92-557952797330 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:45.966045 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1b026c3e-3671-4efc-9c92-557952797330 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:45.966482 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1b026c3e-3671-4efc-9c92-557952797330 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:45.995856 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-1b026c3e-3671-4efc-9c92-557952797330 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043074 Jun 22 09:13:45.997051 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 445/837] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:45 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:47.007570 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-8a8f52de-ab6c-4587-bc71-1b2e3ddad38c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:47.009597 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-8a8f52de-ab6c-4587-bc71-1b2e3ddad38c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:47.015030 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8a8f52de-ab6c-4587-bc71-1b2e3ddad38c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:47.015484 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8a8f52de-ab6c-4587-bc71-1b2e3ddad38c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:47.016248 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8a8f52de-ab6c-4587-bc71-1b2e3ddad38c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:47.016710 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8a8f52de-ab6c-4587-bc71-1b2e3ddad38c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:47.047909 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-8a8f52de-ab6c-4587-bc71-1b2e3ddad38c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044267 Jun 22 09:13:47.048403 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 393/838] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:47 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:48.060200 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-55b61416-ad69-415f-a053-a6043575354d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:48.061157 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-55b61416-ad69-415f-a053-a6043575354d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:48.068475 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-55b61416-ad69-415f-a053-a6043575354d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:48.068973 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-55b61416-ad69-415f-a053-a6043575354d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:48.069739 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-55b61416-ad69-415f-a053-a6043575354d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:48.070180 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-55b61416-ad69-415f-a053-a6043575354d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:48.098687 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-55b61416-ad69-415f-a053-a6043575354d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043065 Jun 22 09:13:48.099161 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 446/839] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:48 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:49.110001 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-05c3d1a7-5a9f-487b-a952-e73ddd9f6e65 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:49.110944 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-05c3d1a7-5a9f-487b-a952-e73ddd9f6e65 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:49.118257 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-05c3d1a7-5a9f-487b-a952-e73ddd9f6e65 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:49.118703 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-05c3d1a7-5a9f-487b-a952-e73ddd9f6e65 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:49.119854 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-05c3d1a7-5a9f-487b-a952-e73ddd9f6e65 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:49.120448 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-05c3d1a7-5a9f-487b-a952-e73ddd9f6e65 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:49.149932 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-05c3d1a7-5a9f-487b-a952-e73ddd9f6e65 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043754 Jun 22 09:13:49.150402 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 394/840] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:49 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:50.161247 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7034787b-94d9-4054-a254-e4670b2691de tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:50.162175 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7034787b-94d9-4054-a254-e4670b2691de tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:50.168752 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7034787b-94d9-4054-a254-e4670b2691de tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:50.169236 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7034787b-94d9-4054-a254-e4670b2691de tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:50.170000 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7034787b-94d9-4054-a254-e4670b2691de tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:50.170445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7034787b-94d9-4054-a254-e4670b2691de tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:50.198578 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7034787b-94d9-4054-a254-e4670b2691de tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041092 Jun 22 09:13:50.199703 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 447/841] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:50 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:51.210591 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-7f29641c-f941-4d07-b72b-61d6cebc96f3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:51.211517 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-7f29641c-f941-4d07-b72b-61d6cebc96f3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:51.218556 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7f29641c-f941-4d07-b72b-61d6cebc96f3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:51.219003 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7f29641c-f941-4d07-b72b-61d6cebc96f3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:51.219766 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7f29641c-f941-4d07-b72b-61d6cebc96f3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:51.220202 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7f29641c-f941-4d07-b72b-61d6cebc96f3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:51.248388 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-7f29641c-f941-4d07-b72b-61d6cebc96f3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041677 Jun 22 09:13:51.248885 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 395/842] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:51 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:52.259659 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-87f01249-681b-4e3c-87b8-b0acae1a1669 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:52.260597 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-87f01249-681b-4e3c-87b8-b0acae1a1669 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:52.267471 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-87f01249-681b-4e3c-87b8-b0acae1a1669 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:52.267929 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-87f01249-681b-4e3c-87b8-b0acae1a1669 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:52.268694 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-87f01249-681b-4e3c-87b8-b0acae1a1669 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:52.269165 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-87f01249-681b-4e3c-87b8-b0acae1a1669 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:52.297755 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-87f01249-681b-4e3c-87b8-b0acae1a1669 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042120 Jun 22 09:13:52.298300 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 448/843] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:52 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:53.309401 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1d96e4b0-5d7e-43d6-b196-edb3a3bd2415 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:53.310330 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1d96e4b0-5d7e-43d6-b196-edb3a3bd2415 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:53.316850 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1d96e4b0-5d7e-43d6-b196-edb3a3bd2415 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:53.317305 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1d96e4b0-5d7e-43d6-b196-edb3a3bd2415 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:53.318068 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1d96e4b0-5d7e-43d6-b196-edb3a3bd2415 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:53.318509 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1d96e4b0-5d7e-43d6-b196-edb3a3bd2415 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:53.347805 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1d96e4b0-5d7e-43d6-b196-edb3a3bd2415 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042512 Jun 22 09:13:53.348357 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 396/844] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:53 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:54.359234 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-12434934-dd19-4d1f-bfd5-0ba3640ec33c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:54.360158 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-12434934-dd19-4d1f-bfd5-0ba3640ec33c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:54.366718 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-12434934-dd19-4d1f-bfd5-0ba3640ec33c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:54.367173 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-12434934-dd19-4d1f-bfd5-0ba3640ec33c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:54.367929 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-12434934-dd19-4d1f-bfd5-0ba3640ec33c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:54.368368 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-12434934-dd19-4d1f-bfd5-0ba3640ec33c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:54.397937 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-12434934-dd19-4d1f-bfd5-0ba3640ec33c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042683 Jun 22 09:13:54.398469 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 449/845] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:54 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:55.409761 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b1bf6edc-3684-4a80-b277-5fdfd268cad2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:55.410696 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-b1bf6edc-3684-4a80-b277-5fdfd268cad2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:55.417162 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b1bf6edc-3684-4a80-b277-5fdfd268cad2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:55.417723 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b1bf6edc-3684-4a80-b277-5fdfd268cad2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:55.418571 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b1bf6edc-3684-4a80-b277-5fdfd268cad2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:55.419015 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b1bf6edc-3684-4a80-b277-5fdfd268cad2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:55.447061 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-b1bf6edc-3684-4a80-b277-5fdfd268cad2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041512 Jun 22 09:13:55.447606 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 397/846] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:55 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:56.458083 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-df51f487-2f2f-4654-b15b-9ce8fbf3be3b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:56.459040 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-df51f487-2f2f-4654-b15b-9ce8fbf3be3b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:56.465627 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-df51f487-2f2f-4654-b15b-9ce8fbf3be3b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:56.466025 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-df51f487-2f2f-4654-b15b-9ce8fbf3be3b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:56.466780 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-df51f487-2f2f-4654-b15b-9ce8fbf3be3b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:56.467218 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-df51f487-2f2f-4654-b15b-9ce8fbf3be3b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:56.495354 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-df51f487-2f2f-4654-b15b-9ce8fbf3be3b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041212 Jun 22 09:13:56.505898 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 450/847] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:56 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:57.516221 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6c8ad9a3-76ff-406a-9326-7a5521753f4f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:57.517185 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-6c8ad9a3-76ff-406a-9326-7a5521753f4f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:57.523658 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6c8ad9a3-76ff-406a-9326-7a5521753f4f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:57.524099 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6c8ad9a3-76ff-406a-9326-7a5521753f4f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:57.524881 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6c8ad9a3-76ff-406a-9326-7a5521753f4f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:57.525339 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6c8ad9a3-76ff-406a-9326-7a5521753f4f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:57.553526 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-6c8ad9a3-76ff-406a-9326-7a5521753f4f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041262 Jun 22 09:13:57.554063 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 398/848] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:57 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:58.565198 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-3a893024-69ca-4741-9ac5-a7737fe05f6a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:58.566124 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-3a893024-69ca-4741-9ac5-a7737fe05f6a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:58.572479 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3a893024-69ca-4741-9ac5-a7737fe05f6a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:58.572968 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3a893024-69ca-4741-9ac5-a7737fe05f6a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:58.573826 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3a893024-69ca-4741-9ac5-a7737fe05f6a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:58.574275 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3a893024-69ca-4741-9ac5-a7737fe05f6a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:58.602217 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-3a893024-69ca-4741-9ac5-a7737fe05f6a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041016 Jun 22 09:13:58.602754 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 451/849] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:58 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:59.614102 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b396cffd-ceac-4c63-9fc3-c23dc9b11406 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:59.615021 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-b396cffd-ceac-4c63-9fc3-c23dc9b11406 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:59.621539 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b396cffd-ceac-4c63-9fc3-c23dc9b11406 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:59.621986 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b396cffd-ceac-4c63-9fc3-c23dc9b11406 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:59.622739 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b396cffd-ceac-4c63-9fc3-c23dc9b11406 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:59.623171 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b396cffd-ceac-4c63-9fc3-c23dc9b11406 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:59.651574 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-b396cffd-ceac-4c63-9fc3-c23dc9b11406 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041354 Jun 22 09:13:59.652862 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 399/850] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:59 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:00.663835 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-72ebf570-de6d-4bb7-8c02-15df44497db0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:00.664766 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-72ebf570-de6d-4bb7-8c02-15df44497db0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:00.672156 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-72ebf570-de6d-4bb7-8c02-15df44497db0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:00.672618 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-72ebf570-de6d-4bb7-8c02-15df44497db0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:00.673529 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-72ebf570-de6d-4bb7-8c02-15df44497db0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:00.674033 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-72ebf570-de6d-4bb7-8c02-15df44497db0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:00.703088 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-72ebf570-de6d-4bb7-8c02-15df44497db0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043232 Jun 22 09:14:00.703640 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 452/851] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:00 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:01.714588 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-55baa442-7773-4b5a-88b1-841a0b4991d9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:01.716338 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-55baa442-7773-4b5a-88b1-841a0b4991d9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:01.722940 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-55baa442-7773-4b5a-88b1-841a0b4991d9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:01.723394 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-55baa442-7773-4b5a-88b1-841a0b4991d9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:01.724160 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-55baa442-7773-4b5a-88b1-841a0b4991d9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:01.724598 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-55baa442-7773-4b5a-88b1-841a0b4991d9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:01.753354 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-55baa442-7773-4b5a-88b1-841a0b4991d9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042651 Jun 22 09:14:01.753909 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 400/852] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:01 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:02.765104 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-536ba429-8515-4278-b40d-9dd9af4d3b75 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:02.766026 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-536ba429-8515-4278-b40d-9dd9af4d3b75 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:02.772498 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-536ba429-8515-4278-b40d-9dd9af4d3b75 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:02.772983 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-536ba429-8515-4278-b40d-9dd9af4d3b75 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:02.773733 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-536ba429-8515-4278-b40d-9dd9af4d3b75 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:02.774167 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-536ba429-8515-4278-b40d-9dd9af4d3b75 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:02.803293 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-536ba429-8515-4278-b40d-9dd9af4d3b75 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042349 Jun 22 09:14:02.803829 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 453/853] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:02 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:03.815421 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1bd9312c-4551-4858-9e2f-38395e94d325 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:03.816377 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1bd9312c-4551-4858-9e2f-38395e94d325 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:03.822902 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1bd9312c-4551-4858-9e2f-38395e94d325 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:03.823356 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1bd9312c-4551-4858-9e2f-38395e94d325 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:03.824118 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1bd9312c-4551-4858-9e2f-38395e94d325 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:03.824554 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1bd9312c-4551-4858-9e2f-38395e94d325 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:03.853249 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1bd9312c-4551-4858-9e2f-38395e94d325 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041758 Jun 22 09:14:03.853805 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 401/854] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:03 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:04.865295 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c836e67b-652c-4cb3-9f73-6656a266a081 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:04.866255 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c836e67b-652c-4cb3-9f73-6656a266a081 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:04.868656 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=30 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:04.874085 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c836e67b-652c-4cb3-9f73-6656a266a081 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:04.874533 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c836e67b-652c-4cb3-9f73-6656a266a081 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:04.875292 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c836e67b-652c-4cb3-9f73-6656a266a081 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:04.875731 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c836e67b-652c-4cb3-9f73-6656a266a081 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:04.904519 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c836e67b-652c-4cb3-9f73-6656a266a081 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043092 Jun 22 09:14:04.905229 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 454/855] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:04 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:05.915412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-46550643-6e38-47ff-937d-53dc0c9ee5e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:05.916332 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-46550643-6e38-47ff-937d-53dc0c9ee5e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:05.923738 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-46550643-6e38-47ff-937d-53dc0c9ee5e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:05.924183 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-46550643-6e38-47ff-937d-53dc0c9ee5e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:05.924971 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-46550643-6e38-47ff-937d-53dc0c9ee5e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:05.925408 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-46550643-6e38-47ff-937d-53dc0c9ee5e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:05.954306 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-46550643-6e38-47ff-937d-53dc0c9ee5e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042741 Jun 22 09:14:05.954868 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 402/856] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:05 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:06.965038 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-fe01c7b5-2a4e-4b6c-b785-b83e91e75982 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:06.966521 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-fe01c7b5-2a4e-4b6c-b785-b83e91e75982 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:06.973436 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fe01c7b5-2a4e-4b6c-b785-b83e91e75982 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:06.973890 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fe01c7b5-2a4e-4b6c-b785-b83e91e75982 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:06.974659 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fe01c7b5-2a4e-4b6c-b785-b83e91e75982 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:06.975102 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fe01c7b5-2a4e-4b6c-b785-b83e91e75982 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:07.003986 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-fe01c7b5-2a4e-4b6c-b785-b83e91e75982 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042933 Jun 22 09:14:07.004539 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 455/857] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:06 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:08.014457 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-5caf5f5c-04ee-4fb3-b6d7-1fd168079292 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:08.015378 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-5caf5f5c-04ee-4fb3-b6d7-1fd168079292 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:08.021714 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5caf5f5c-04ee-4fb3-b6d7-1fd168079292 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:08.022160 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5caf5f5c-04ee-4fb3-b6d7-1fd168079292 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:08.022912 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5caf5f5c-04ee-4fb3-b6d7-1fd168079292 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:08.023343 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5caf5f5c-04ee-4fb3-b6d7-1fd168079292 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:08.052516 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-5caf5f5c-04ee-4fb3-b6d7-1fd168079292 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042047 Jun 22 09:14:08.053083 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 403/858] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:08 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:09.063692 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-dfec389f-c13c-45b5-aaab-0d6f9ebe4cfd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:09.064611 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-dfec389f-c13c-45b5-aaab-0d6f9ebe4cfd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:09.071029 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dfec389f-c13c-45b5-aaab-0d6f9ebe4cfd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:09.071479 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dfec389f-c13c-45b5-aaab-0d6f9ebe4cfd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:09.072233 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dfec389f-c13c-45b5-aaab-0d6f9ebe4cfd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:09.072677 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dfec389f-c13c-45b5-aaab-0d6f9ebe4cfd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:09.075819 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=96 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:09.102638 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-dfec389f-c13c-45b5-aaab-0d6f9ebe4cfd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043084 Jun 22 09:14:09.103178 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 456/859] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:09 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:10.114508 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1d25d809-c0ad-43c1-b8f8-12480e61c6a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:10.115473 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1d25d809-c0ad-43c1-b8f8-12480e61c6a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:10.122021 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1d25d809-c0ad-43c1-b8f8-12480e61c6a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:10.122503 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1d25d809-c0ad-43c1-b8f8-12480e61c6a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:10.123260 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1d25d809-c0ad-43c1-b8f8-12480e61c6a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:10.123694 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1d25d809-c0ad-43c1-b8f8-12480e61c6a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:10.126080 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=96 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:10.153794 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1d25d809-c0ad-43c1-b8f8-12480e61c6a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042715 Jun 22 09:14:10.154340 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 404/860] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:10 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:11.164593 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-07c57a99-aa65-4fbc-bbe8-48e2cef1cbb5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:11.165775 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-07c57a99-aa65-4fbc-bbe8-48e2cef1cbb5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:11.173392 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-07c57a99-aa65-4fbc-bbe8-48e2cef1cbb5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:11.173844 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-07c57a99-aa65-4fbc-bbe8-48e2cef1cbb5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:11.174611 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-07c57a99-aa65-4fbc-bbe8-48e2cef1cbb5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:11.175049 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-07c57a99-aa65-4fbc-bbe8-48e2cef1cbb5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:11.204829 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-07c57a99-aa65-4fbc-bbe8-48e2cef1cbb5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044088 Jun 22 09:14:11.205392 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 457/861] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:11 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:14:12.216595 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-8e84dc15-a39d-41c9-8d6f-6ea7baca0a2a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:12.217594 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-8e84dc15-a39d-41c9-8d6f-6ea7baca0a2a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:12.220201 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=30 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:12.224984 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8e84dc15-a39d-41c9-8d6f-6ea7baca0a2a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:12.225423 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8e84dc15-a39d-41c9-8d6f-6ea7baca0a2a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:12.226183 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8e84dc15-a39d-41c9-8d6f-6ea7baca0a2a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:12.226623 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8e84dc15-a39d-41c9-8d6f-6ea7baca0a2a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:12.255782 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-8e84dc15-a39d-41c9-8d6f-6ea7baca0a2a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044179 Jun 22 09:14:12.256333 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 405/862] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:12 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:14:13.268442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-4ebb39d4-abde-4a42-9c67-31a0161fa198 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:13.270293 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-4ebb39d4-abde-4a42-9c67-31a0161fa198 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:13.277559 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4ebb39d4-abde-4a42-9c67-31a0161fa198 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:13.278561 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4ebb39d4-abde-4a42-9c67-31a0161fa198 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:13.279333 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4ebb39d4-abde-4a42-9c67-31a0161fa198 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:13.279772 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4ebb39d4-abde-4a42-9c67-31a0161fa198 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:13.309653 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-4ebb39d4-abde-4a42-9c67-31a0161fa198 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045586 Jun 22 09:14:13.310213 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 458/863] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:13 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:14.321457 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3ef7a209-3ae1-4745-a0cd-87b730531a68 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:14.322450 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3ef7a209-3ae1-4745-a0cd-87b730531a68 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:14.329769 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3ef7a209-3ae1-4745-a0cd-87b730531a68 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:14.330223 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3ef7a209-3ae1-4745-a0cd-87b730531a68 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:14.330995 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3ef7a209-3ae1-4745-a0cd-87b730531a68 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:14.331434 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3ef7a209-3ae1-4745-a0cd-87b730531a68 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:14.360812 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3ef7a209-3ae1-4745-a0cd-87b730531a68 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043300 Jun 22 09:14:14.361384 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 406/864] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:14 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:15.372045 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9c2ed8a2-d0ad-4b06-a44b-7e43697a97f6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:15.373016 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9c2ed8a2-d0ad-4b06-a44b-7e43697a97f6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:15.379634 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9c2ed8a2-d0ad-4b06-a44b-7e43697a97f6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:15.380096 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9c2ed8a2-d0ad-4b06-a44b-7e43697a97f6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:15.380894 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9c2ed8a2-d0ad-4b06-a44b-7e43697a97f6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:15.381348 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9c2ed8a2-d0ad-4b06-a44b-7e43697a97f6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:15.410815 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9c2ed8a2-d0ad-4b06-a44b-7e43697a97f6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042629 Jun 22 09:14:15.411359 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 459/865] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:15 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:16.422613 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ce8db74a-e56b-44bd-9d50-468830e2c493 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:16.423636 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ce8db74a-e56b-44bd-9d50-468830e2c493 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:16.430459 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ce8db74a-e56b-44bd-9d50-468830e2c493 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:16.430905 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ce8db74a-e56b-44bd-9d50-468830e2c493 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:16.431978 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ce8db74a-e56b-44bd-9d50-468830e2c493 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:16.432424 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ce8db74a-e56b-44bd-9d50-468830e2c493 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:16.461069 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ce8db74a-e56b-44bd-9d50-468830e2c493 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042779 Jun 22 09:14:16.461616 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 407/866] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:16 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:17.471584 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f8adf681-b77d-4879-b171-efd4e4282db5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:17.472577 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-f8adf681-b77d-4879-b171-efd4e4282db5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:17.479021 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f8adf681-b77d-4879-b171-efd4e4282db5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:17.479493 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f8adf681-b77d-4879-b171-efd4e4282db5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:17.480250 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f8adf681-b77d-4879-b171-efd4e4282db5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:17.480679 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f8adf681-b77d-4879-b171-efd4e4282db5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:17.509266 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f8adf681-b77d-4879-b171-efd4e4282db5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041554 Jun 22 09:14:17.509808 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 460/867] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:17 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:18.524229 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-412e186d-56bd-4cbc-bc06-d29c2c451adf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:18.525890 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-412e186d-56bd-4cbc-bc06-d29c2c451adf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:18.536641 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-412e186d-56bd-4cbc-bc06-d29c2c451adf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:18.537106 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-412e186d-56bd-4cbc-bc06-d29c2c451adf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:18.537874 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-412e186d-56bd-4cbc-bc06-d29c2c451adf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:18.538306 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-412e186d-56bd-4cbc-bc06-d29c2c451adf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:18.566721 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-412e186d-56bd-4cbc-bc06-d29c2c451adf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049299 Jun 22 09:14:18.567263 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 408/868] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:18 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:19.578187 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-157d8ecc-8d83-43c1-a66d-92aa1adbfe4e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:19.579618 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-157d8ecc-8d83-43c1-a66d-92aa1adbfe4e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:19.586034 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-157d8ecc-8d83-43c1-a66d-92aa1adbfe4e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:19.586506 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-157d8ecc-8d83-43c1-a66d-92aa1adbfe4e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:19.587269 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-157d8ecc-8d83-43c1-a66d-92aa1adbfe4e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:19.587709 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-157d8ecc-8d83-43c1-a66d-92aa1adbfe4e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:19.617138 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-157d8ecc-8d83-43c1-a66d-92aa1adbfe4e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042536 Jun 22 09:14:19.617682 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 461/869] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:19 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:20.629155 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1a9ea1d4-9540-4ffa-80af-01e4812d176e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:20.630090 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1a9ea1d4-9540-4ffa-80af-01e4812d176e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:20.636068 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1a9ea1d4-9540-4ffa-80af-01e4812d176e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:20.636542 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1a9ea1d4-9540-4ffa-80af-01e4812d176e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:20.637344 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1a9ea1d4-9540-4ffa-80af-01e4812d176e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:20.637790 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1a9ea1d4-9540-4ffa-80af-01e4812d176e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:20.667389 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1a9ea1d4-9540-4ffa-80af-01e4812d176e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042880 Jun 22 09:14:20.673380 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 409/870] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:20 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:21.681913 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-cdb5208b-4c91-4b4a-b7ae-5e46ef320be5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:21.682836 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-cdb5208b-4c91-4b4a-b7ae-5e46ef320be5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:21.689090 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cdb5208b-4c91-4b4a-b7ae-5e46ef320be5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:21.689568 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cdb5208b-4c91-4b4a-b7ae-5e46ef320be5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:21.690354 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cdb5208b-4c91-4b4a-b7ae-5e46ef320be5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:21.690790 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cdb5208b-4c91-4b4a-b7ae-5e46ef320be5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:21.719742 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-cdb5208b-4c91-4b4a-b7ae-5e46ef320be5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041073 Jun 22 09:14:21.720272 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 462/871] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:21 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:22.731094 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-2df18f8d-5061-4f7d-a62c-bd9f7c9f16a5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:22.732014 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-2df18f8d-5061-4f7d-a62c-bd9f7c9f16a5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:22.738652 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2df18f8d-5061-4f7d-a62c-bd9f7c9f16a5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:22.739124 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2df18f8d-5061-4f7d-a62c-bd9f7c9f16a5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:22.739888 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2df18f8d-5061-4f7d-a62c-bd9f7c9f16a5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:22.740326 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2df18f8d-5061-4f7d-a62c-bd9f7c9f16a5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:22.770491 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-2df18f8d-5061-4f7d-a62c-bd9f7c9f16a5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043297 Jun 22 09:14:22.771047 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 410/872] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:22 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:23.782383 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-1448f5c6-31b5-4615-936e-38309f1287ac tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:23.783300 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-1448f5c6-31b5-4615-936e-38309f1287ac tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:23.789941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1448f5c6-31b5-4615-936e-38309f1287ac tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:23.790385 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1448f5c6-31b5-4615-936e-38309f1287ac tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:23.791150 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1448f5c6-31b5-4615-936e-38309f1287ac tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:23.791586 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1448f5c6-31b5-4615-936e-38309f1287ac tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:23.819979 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-1448f5c6-31b5-4615-936e-38309f1287ac tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042334 Jun 22 09:14:23.820517 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 463/873] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:23 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:24.831375 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-9f738d25-d2df-4c37-b18f-8c7cc699ca25 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:24.832300 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-9f738d25-d2df-4c37-b18f-8c7cc699ca25 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:24.838930 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9f738d25-d2df-4c37-b18f-8c7cc699ca25 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:24.839385 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9f738d25-d2df-4c37-b18f-8c7cc699ca25 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:24.840148 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9f738d25-d2df-4c37-b18f-8c7cc699ca25 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:24.840585 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9f738d25-d2df-4c37-b18f-8c7cc699ca25 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:24.870564 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-9f738d25-d2df-4c37-b18f-8c7cc699ca25 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043141 Jun 22 09:14:24.871115 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 411/874] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:24 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:25.883448 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-550158f8-8ec7-4fc0-9ece-851988be244a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:25.885228 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-550158f8-8ec7-4fc0-9ece-851988be244a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:25.892637 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-550158f8-8ec7-4fc0-9ece-851988be244a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:25.893398 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-550158f8-8ec7-4fc0-9ece-851988be244a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:25.894517 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-550158f8-8ec7-4fc0-9ece-851988be244a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:25.895173 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-550158f8-8ec7-4fc0-9ece-851988be244a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:25.926094 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-550158f8-8ec7-4fc0-9ece-851988be244a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047659 Jun 22 09:14:25.927534 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 464/875] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:25 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:26.938378 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-27825c63-c686-423f-871d-a4531d3eb3ce tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:26.939930 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-27825c63-c686-423f-871d-a4531d3eb3ce tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:26.946871 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-27825c63-c686-423f-871d-a4531d3eb3ce tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:26.947537 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-27825c63-c686-423f-871d-a4531d3eb3ce tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:26.948484 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-27825c63-c686-423f-871d-a4531d3eb3ce tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:26.949110 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-27825c63-c686-423f-871d-a4531d3eb3ce tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:26.979008 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-27825c63-c686-423f-871d-a4531d3eb3ce tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045103 Jun 22 09:14:26.979923 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 412/876] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:26 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:27.162740 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-941732e5-089a-4071-8423-58e8d15920b6 tempest-TestVolumeBootPattern-1963305283 tempest-TestVolumeBootPattern-1963305283-project] Calling method '.version_select at 0x7f5756190b80>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:27.244181 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-941732e5-089a-4071-8423-58e8d15920b6 tempest-TestVolumeBootPattern-1963305283 tempest-TestVolumeBootPattern-1963305283-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-868085579" status: 202 len: 0 microversion: 2.1 time: 0.085214 Jun 22 09:14:27.244766 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 465/877] 10.222.0.16 () {58 vars in 1259 bytes} [Wed Jun 22 09:14:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-868085579 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:14:27.990621 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3c4ee657-1b6e-4046-94a9-827b61e6b336 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:27.991552 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3c4ee657-1b6e-4046-94a9-827b61e6b336 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:27.997823 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3c4ee657-1b6e-4046-94a9-827b61e6b336 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:27.998281 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3c4ee657-1b6e-4046-94a9-827b61e6b336 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:27.999076 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3c4ee657-1b6e-4046-94a9-827b61e6b336 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:27.999538 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3c4ee657-1b6e-4046-94a9-827b61e6b336 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:28.029111 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3c4ee657-1b6e-4046-94a9-827b61e6b336 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042589 Jun 22 09:14:28.029929 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 413/878] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:27 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:29.042574 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-28803c32-0933-4a96-8fbf-6cd328747467 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:29.042574 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-28803c32-0933-4a96-8fbf-6cd328747467 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:29.066549 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-28803c32-0933-4a96-8fbf-6cd328747467 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:29.067929 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-28803c32-0933-4a96-8fbf-6cd328747467 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:29.069028 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-28803c32-0933-4a96-8fbf-6cd328747467 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:29.072817 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-28803c32-0933-4a96-8fbf-6cd328747467 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:29.118469 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-28803c32-0933-4a96-8fbf-6cd328747467 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081134 Jun 22 09:14:29.122910 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 466/879] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:29 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:30.130668 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-15700914-16c5-473b-a204-c2fae89f3a23 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:30.131604 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-15700914-16c5-473b-a204-c2fae89f3a23 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:30.138931 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-15700914-16c5-473b-a204-c2fae89f3a23 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:30.139394 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-15700914-16c5-473b-a204-c2fae89f3a23 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:30.140178 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-15700914-16c5-473b-a204-c2fae89f3a23 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:30.141516 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-15700914-16c5-473b-a204-c2fae89f3a23 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:30.174537 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-15700914-16c5-473b-a204-c2fae89f3a23 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047762 Jun 22 09:14:30.182891 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 414/880] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:30 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:31.186760 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-df911781-c886-431e-a337-f0ccfefc903e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:31.187838 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-df911781-c886-431e-a337-f0ccfefc903e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:31.202479 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-df911781-c886-431e-a337-f0ccfefc903e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:31.203255 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-df911781-c886-431e-a337-f0ccfefc903e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:31.204055 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-df911781-c886-431e-a337-f0ccfefc903e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:31.204500 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-df911781-c886-431e-a337-f0ccfefc903e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:31.258646 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-df911781-c886-431e-a337-f0ccfefc903e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076145 Jun 22 09:14:31.259497 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 467/881] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:31 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:32.271536 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-966d86f4-b3f5-4f7c-bbfe-c26a40abffd3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:32.273130 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-966d86f4-b3f5-4f7c-bbfe-c26a40abffd3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:32.281973 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-966d86f4-b3f5-4f7c-bbfe-c26a40abffd3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:32.282745 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-966d86f4-b3f5-4f7c-bbfe-c26a40abffd3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:32.283591 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-966d86f4-b3f5-4f7c-bbfe-c26a40abffd3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:32.284167 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-966d86f4-b3f5-4f7c-bbfe-c26a40abffd3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:32.315742 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-966d86f4-b3f5-4f7c-bbfe-c26a40abffd3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048092 Jun 22 09:14:32.316392 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 415/882] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:32 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:33.327304 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f4305cdc-620c-44ef-8aa9-30628be06c3d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:33.328353 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-f4305cdc-620c-44ef-8aa9-30628be06c3d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:33.335803 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f4305cdc-620c-44ef-8aa9-30628be06c3d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:33.336551 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f4305cdc-620c-44ef-8aa9-30628be06c3d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:33.336981 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f4305cdc-620c-44ef-8aa9-30628be06c3d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:33.337419 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f4305cdc-620c-44ef-8aa9-30628be06c3d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:33.370655 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f4305cdc-620c-44ef-8aa9-30628be06c3d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047240 Jun 22 09:14:33.375517 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 468/883] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:33 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:34.387734 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a7700286-3196-4e65-94c3-98af3f9d4888 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:34.389968 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a7700286-3196-4e65-94c3-98af3f9d4888 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:34.398464 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a7700286-3196-4e65-94c3-98af3f9d4888 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:34.399340 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a7700286-3196-4e65-94c3-98af3f9d4888 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:34.400378 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a7700286-3196-4e65-94c3-98af3f9d4888 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:34.401189 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a7700286-3196-4e65-94c3-98af3f9d4888 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:34.443555 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a7700286-3196-4e65-94c3-98af3f9d4888 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064700 Jun 22 09:14:34.443555 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 416/884] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:34 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:35.455974 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-779b0bbf-f52a-4397-b5c5-f11280eea7c3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:35.457296 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-779b0bbf-f52a-4397-b5c5-f11280eea7c3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:35.463867 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-779b0bbf-f52a-4397-b5c5-f11280eea7c3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:35.464397 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-779b0bbf-f52a-4397-b5c5-f11280eea7c3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:35.465197 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-779b0bbf-f52a-4397-b5c5-f11280eea7c3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:35.465639 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-779b0bbf-f52a-4397-b5c5-f11280eea7c3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:35.496396 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-779b0bbf-f52a-4397-b5c5-f11280eea7c3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045120 Jun 22 09:14:35.497186 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 469/885] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:35 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:36.508614 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-37c808f5-17cc-4898-b76e-6281e55e015e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:36.510158 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-37c808f5-17cc-4898-b76e-6281e55e015e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:36.520336 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-37c808f5-17cc-4898-b76e-6281e55e015e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:36.520819 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-37c808f5-17cc-4898-b76e-6281e55e015e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:36.521603 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-37c808f5-17cc-4898-b76e-6281e55e015e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:36.522095 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-37c808f5-17cc-4898-b76e-6281e55e015e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:36.553001 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-37c808f5-17cc-4898-b76e-6281e55e015e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048244 Jun 22 09:14:36.553779 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 417/886] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:36 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:37.564695 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-b91b4220-19e4-4bd6-834c-48297c988feb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:37.565640 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-b91b4220-19e4-4bd6-834c-48297c988feb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:37.567931 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:37.572621 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b91b4220-19e4-4bd6-834c-48297c988feb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:37.573092 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b91b4220-19e4-4bd6-834c-48297c988feb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:37.573850 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b91b4220-19e4-4bd6-834c-48297c988feb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:37.574316 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b91b4220-19e4-4bd6-834c-48297c988feb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:37.603668 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-b91b4220-19e4-4bd6-834c-48297c988feb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043552 Jun 22 09:14:37.604212 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 470/887] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:37 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:38.615711 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6bd63e52-3616-490a-9bfe-6caded57191b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:38.616628 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-6bd63e52-3616-490a-9bfe-6caded57191b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:38.623080 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6bd63e52-3616-490a-9bfe-6caded57191b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:38.623527 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6bd63e52-3616-490a-9bfe-6caded57191b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:38.624324 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6bd63e52-3616-490a-9bfe-6caded57191b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:38.624758 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6bd63e52-3616-490a-9bfe-6caded57191b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:38.653396 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-6bd63e52-3616-490a-9bfe-6caded57191b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041473 Jun 22 09:14:38.653953 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 418/888] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:38 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:39.665731 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a197a17b-169a-4178-91e1-d1789cea386b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:39.666646 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-a197a17b-169a-4178-91e1-d1789cea386b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:39.673887 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a197a17b-169a-4178-91e1-d1789cea386b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:39.674335 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a197a17b-169a-4178-91e1-d1789cea386b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:39.675086 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a197a17b-169a-4178-91e1-d1789cea386b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:39.675521 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a197a17b-169a-4178-91e1-d1789cea386b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:39.706768 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a197a17b-169a-4178-91e1-d1789cea386b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044930 Jun 22 09:14:39.707360 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 471/889] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:39 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:40.718963 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-d96b2169-1295-4c1b-8d4f-5ec7c5aec734 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:40.719912 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-d96b2169-1295-4c1b-8d4f-5ec7c5aec734 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:40.726378 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d96b2169-1295-4c1b-8d4f-5ec7c5aec734 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:40.726832 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d96b2169-1295-4c1b-8d4f-5ec7c5aec734 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:40.727590 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d96b2169-1295-4c1b-8d4f-5ec7c5aec734 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:40.728029 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d96b2169-1295-4c1b-8d4f-5ec7c5aec734 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:40.758202 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-d96b2169-1295-4c1b-8d4f-5ec7c5aec734 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043365 Jun 22 09:14:40.758778 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 419/890] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:40 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:41.770109 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-5e3d5b29-7eb0-432d-9369-a720279546b2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:41.771030 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-5e3d5b29-7eb0-432d-9369-a720279546b2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:41.777441 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5e3d5b29-7eb0-432d-9369-a720279546b2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:41.777887 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5e3d5b29-7eb0-432d-9369-a720279546b2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:41.778639 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5e3d5b29-7eb0-432d-9369-a720279546b2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:41.779329 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5e3d5b29-7eb0-432d-9369-a720279546b2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:41.782329 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=90 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:41.809257 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-5e3d5b29-7eb0-432d-9369-a720279546b2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043017 Jun 22 09:14:41.809815 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 472/891] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:41 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:42.820944 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b361ae5c-e09f-4e2e-afd1-9f065079f465 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:42.821802 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-b361ae5c-e09f-4e2e-afd1-9f065079f465 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:42.824096 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=30 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:42.828925 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b361ae5c-e09f-4e2e-afd1-9f065079f465 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:42.829389 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b361ae5c-e09f-4e2e-afd1-9f065079f465 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:42.830163 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b361ae5c-e09f-4e2e-afd1-9f065079f465 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:42.830606 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b361ae5c-e09f-4e2e-afd1-9f065079f465 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:42.833089 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=96 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:42.862279 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-b361ae5c-e09f-4e2e-afd1-9f065079f465 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045353 Jun 22 09:14:42.862842 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 420/892] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:42 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:43.874728 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e5714dca-5800-4b74-9131-c9dc7669104e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:43.875768 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e5714dca-5800-4b74-9131-c9dc7669104e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:43.882406 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e5714dca-5800-4b74-9131-c9dc7669104e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:43.882881 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e5714dca-5800-4b74-9131-c9dc7669104e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:43.883654 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e5714dca-5800-4b74-9131-c9dc7669104e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:43.884097 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e5714dca-5800-4b74-9131-c9dc7669104e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:43.915336 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e5714dca-5800-4b74-9131-c9dc7669104e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045421 Jun 22 09:14:43.916017 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 473/893] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:43 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:44.927866 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-5a1017ec-6608-4b48-9dfa-059946af495b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:44.928795 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-5a1017ec-6608-4b48-9dfa-059946af495b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:44.935507 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5a1017ec-6608-4b48-9dfa-059946af495b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:44.935959 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5a1017ec-6608-4b48-9dfa-059946af495b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:44.938056 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5a1017ec-6608-4b48-9dfa-059946af495b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:44.938513 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5a1017ec-6608-4b48-9dfa-059946af495b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:44.968652 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-5a1017ec-6608-4b48-9dfa-059946af495b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044472 Jun 22 09:14:44.970194 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 421/894] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:44 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:45.979418 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-8694e360-d620-4ed0-9e27-f9f8016f41b9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:45.980352 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-8694e360-d620-4ed0-9e27-f9f8016f41b9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:45.987192 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8694e360-d620-4ed0-9e27-f9f8016f41b9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:45.987644 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8694e360-d620-4ed0-9e27-f9f8016f41b9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:45.988409 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8694e360-d620-4ed0-9e27-f9f8016f41b9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:45.988869 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8694e360-d620-4ed0-9e27-f9f8016f41b9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:46.026961 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-8694e360-d620-4ed0-9e27-f9f8016f41b9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051464 Jun 22 09:14:46.027725 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 474/895] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:45 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:47.038994 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-4e97ac2e-97ab-4dc5-87a0-4c7b81e855e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:47.043067 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-4e97ac2e-97ab-4dc5-87a0-4c7b81e855e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:47.047012 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4e97ac2e-97ab-4dc5-87a0-4c7b81e855e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:47.047466 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4e97ac2e-97ab-4dc5-87a0-4c7b81e855e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:47.048267 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4e97ac2e-97ab-4dc5-87a0-4c7b81e855e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:47.048704 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4e97ac2e-97ab-4dc5-87a0-4c7b81e855e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:47.079372 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-4e97ac2e-97ab-4dc5-87a0-4c7b81e855e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044442 Jun 22 09:14:47.079928 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 422/896] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:47 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:48.090792 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-23a69df1-74bc-4e6d-bc39-10deb19dbac1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:48.091792 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-23a69df1-74bc-4e6d-bc39-10deb19dbac1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:48.098517 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-23a69df1-74bc-4e6d-bc39-10deb19dbac1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:48.098969 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-23a69df1-74bc-4e6d-bc39-10deb19dbac1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:48.099761 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-23a69df1-74bc-4e6d-bc39-10deb19dbac1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:48.100201 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-23a69df1-74bc-4e6d-bc39-10deb19dbac1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:48.130952 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-23a69df1-74bc-4e6d-bc39-10deb19dbac1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044104 Jun 22 09:14:48.131490 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 475/897] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:48 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:49.142648 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a8bd172c-a258-4a06-b583-4f5460a42915 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:49.143572 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a8bd172c-a258-4a06-b583-4f5460a42915 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:49.150317 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a8bd172c-a258-4a06-b583-4f5460a42915 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:49.150776 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a8bd172c-a258-4a06-b583-4f5460a42915 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:49.151556 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a8bd172c-a258-4a06-b583-4f5460a42915 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:49.160774 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a8bd172c-a258-4a06-b583-4f5460a42915 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:49.185468 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a8bd172c-a258-4a06-b583-4f5460a42915 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046922 Jun 22 09:14:49.186573 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 423/898] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:49 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:50.197469 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-39f8159d-be41-4489-942d-decd7f996bff tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:50.198524 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-39f8159d-be41-4489-942d-decd7f996bff tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:50.205902 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-39f8159d-be41-4489-942d-decd7f996bff tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:50.206378 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-39f8159d-be41-4489-942d-decd7f996bff tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:50.207149 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-39f8159d-be41-4489-942d-decd7f996bff tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:50.207591 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-39f8159d-be41-4489-942d-decd7f996bff tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:50.242193 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-39f8159d-be41-4489-942d-decd7f996bff tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048594 Jun 22 09:14:50.242750 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 476/899] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:50 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:51.254801 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-e0330bff-dbfa-4a08-b2a7-b30be26f59aa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:51.255727 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-e0330bff-dbfa-4a08-b2a7-b30be26f59aa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:51.262354 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e0330bff-dbfa-4a08-b2a7-b30be26f59aa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:51.262819 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e0330bff-dbfa-4a08-b2a7-b30be26f59aa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:51.263660 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e0330bff-dbfa-4a08-b2a7-b30be26f59aa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:51.264027 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e0330bff-dbfa-4a08-b2a7-b30be26f59aa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:51.295474 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-e0330bff-dbfa-4a08-b2a7-b30be26f59aa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044572 Jun 22 09:14:51.300296 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 424/900] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:51 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:52.307387 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e9b5cc1a-edf0-4d05-93da-a2ad1a62e8b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:52.308309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e9b5cc1a-edf0-4d05-93da-a2ad1a62e8b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:52.316848 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e9b5cc1a-edf0-4d05-93da-a2ad1a62e8b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:52.317305 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e9b5cc1a-edf0-4d05-93da-a2ad1a62e8b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:52.318072 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e9b5cc1a-edf0-4d05-93da-a2ad1a62e8b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:52.318515 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e9b5cc1a-edf0-4d05-93da-a2ad1a62e8b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:52.347438 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e9b5cc1a-edf0-4d05-93da-a2ad1a62e8b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043924 Jun 22 09:14:52.348170 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 477/901] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:52 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:53.358945 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-977d7ce5-3a80-4229-8bf9-e74e71ded22e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:53.359910 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-977d7ce5-3a80-4229-8bf9-e74e71ded22e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:53.366682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-977d7ce5-3a80-4229-8bf9-e74e71ded22e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:53.367139 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-977d7ce5-3a80-4229-8bf9-e74e71ded22e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:53.367907 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-977d7ce5-3a80-4229-8bf9-e74e71ded22e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:53.368343 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-977d7ce5-3a80-4229-8bf9-e74e71ded22e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:53.399655 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-977d7ce5-3a80-4229-8bf9-e74e71ded22e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044808 Jun 22 09:14:53.400214 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 425/902] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:53 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:54.412090 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9c5bea3f-bab2-4eb3-b5b8-397ee8e6d3a1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:54.413058 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9c5bea3f-bab2-4eb3-b5b8-397ee8e6d3a1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:54.419245 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9c5bea3f-bab2-4eb3-b5b8-397ee8e6d3a1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:54.419697 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9c5bea3f-bab2-4eb3-b5b8-397ee8e6d3a1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:54.420467 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9c5bea3f-bab2-4eb3-b5b8-397ee8e6d3a1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:54.423733 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9c5bea3f-bab2-4eb3-b5b8-397ee8e6d3a1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:54.451747 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9c5bea3f-bab2-4eb3-b5b8-397ee8e6d3a1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043461 Jun 22 09:14:54.452538 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 478/903] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:54 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:55.463211 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-927234ba-0068-4166-a4a9-6d6fbf308484 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:55.464129 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-927234ba-0068-4166-a4a9-6d6fbf308484 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:55.470836 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-927234ba-0068-4166-a4a9-6d6fbf308484 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:55.471286 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-927234ba-0068-4166-a4a9-6d6fbf308484 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:55.472048 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-927234ba-0068-4166-a4a9-6d6fbf308484 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:55.472480 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-927234ba-0068-4166-a4a9-6d6fbf308484 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:55.502809 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-927234ba-0068-4166-a4a9-6d6fbf308484 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043441 Jun 22 09:14:55.503369 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 426/904] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:55 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:56.514325 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f53dc9e2-8dad-4802-9e4e-5679b142ce4b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:56.515263 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-f53dc9e2-8dad-4802-9e4e-5679b142ce4b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:56.522594 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f53dc9e2-8dad-4802-9e4e-5679b142ce4b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:56.523044 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f53dc9e2-8dad-4802-9e4e-5679b142ce4b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:56.523801 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f53dc9e2-8dad-4802-9e4e-5679b142ce4b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:56.524233 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f53dc9e2-8dad-4802-9e4e-5679b142ce4b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:56.553363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f53dc9e2-8dad-4802-9e4e-5679b142ce4b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042996 Jun 22 09:14:56.553919 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 479/905] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:56 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:57.565135 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-0bd7ec2b-fca0-4729-bc4e-9e216be9d66f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:57.566099 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-0bd7ec2b-fca0-4729-bc4e-9e216be9d66f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:57.572735 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0bd7ec2b-fca0-4729-bc4e-9e216be9d66f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:57.573254 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0bd7ec2b-fca0-4729-bc4e-9e216be9d66f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:57.574001 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0bd7ec2b-fca0-4729-bc4e-9e216be9d66f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:57.574498 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0bd7ec2b-fca0-4729-bc4e-9e216be9d66f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:57.612642 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-0bd7ec2b-fca0-4729-bc4e-9e216be9d66f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051444 Jun 22 09:14:57.613229 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 427/906] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:57 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:58.623818 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-08071db6-4b71-444e-b751-a1b365cd8724 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:58.624767 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-08071db6-4b71-444e-b751-a1b365cd8724 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:58.631583 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-08071db6-4b71-444e-b751-a1b365cd8724 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:58.632111 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-08071db6-4b71-444e-b751-a1b365cd8724 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:58.632948 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-08071db6-4b71-444e-b751-a1b365cd8724 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:58.633393 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-08071db6-4b71-444e-b751-a1b365cd8724 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:58.664372 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-08071db6-4b71-444e-b751-a1b365cd8724 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044689 Jun 22 09:14:58.664958 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 480/907] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:58 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:59.173571 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:14:59.173742 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Wed Jun 22 09:14:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:14:59.675932 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-2ebe158e-3d8b-4199-aa99-796c416f4606 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:59.676884 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-2ebe158e-3d8b-4199-aa99-796c416f4606 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:59.683283 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2ebe158e-3d8b-4199-aa99-796c416f4606 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:59.683810 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2ebe158e-3d8b-4199-aa99-796c416f4606 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:59.684486 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2ebe158e-3d8b-4199-aa99-796c416f4606 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:59.684954 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2ebe158e-3d8b-4199-aa99-796c416f4606 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:59.714254 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-2ebe158e-3d8b-4199-aa99-796c416f4606 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042759 Jun 22 09:14:59.714814 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 428/908] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:59 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:15:00.728418 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-351560c8-db56-4ea2-87a1-b4c9a22cb775 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:00.729407 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-351560c8-db56-4ea2-87a1-b4c9a22cb775 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:00.736909 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-351560c8-db56-4ea2-87a1-b4c9a22cb775 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:00.737374 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-351560c8-db56-4ea2-87a1-b4c9a22cb775 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:00.738156 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-351560c8-db56-4ea2-87a1-b4c9a22cb775 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:00.738599 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-351560c8-db56-4ea2-87a1-b4c9a22cb775 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:00.770754 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-351560c8-db56-4ea2-87a1-b4c9a22cb775 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047345 Jun 22 09:15:00.771673 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 481/909] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:00 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:01.696146 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f26918b0-35a3-48de-9326-34d81046fcd2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:01.697480 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f26918b0-35a3-48de-9326-34d81046fcd2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:01.703096 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f26918b0-35a3-48de-9326-34d81046fcd2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:01.703620 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f26918b0-35a3-48de-9326-34d81046fcd2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:01.704334 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f26918b0-35a3-48de-9326-34d81046fcd2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:01.705833 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f26918b0-35a3-48de-9326-34d81046fcd2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:01.744012 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f26918b0-35a3-48de-9326-34d81046fcd2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Going to try to terminate instance {{(pid=118024) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:15:01.788628 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-5ebce70c-35ff-4b2d-b586-9a93f76c9c1f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:01.789708 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-5ebce70c-35ff-4b2d-b586-9a93f76c9c1f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:01.796722 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5ebce70c-35ff-4b2d-b586-9a93f76c9c1f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:01.802564 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5ebce70c-35ff-4b2d-b586-9a93f76c9c1f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:01.802564 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5ebce70c-35ff-4b2d-b586-9a93f76c9c1f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:01.802564 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5ebce70c-35ff-4b2d-b586-9a93f76c9c1f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:01.828885 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-5ebce70c-35ff-4b2d-b586-9a93f76c9c1f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044044 Jun 22 09:15:01.829677 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 482/910] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:01 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:02.055529 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f26918b0-35a3-48de-9326-34d81046fcd2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 204 len: 0 microversion: 2.1 time: 0.362886 Jun 22 09:15:02.056129 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 429/911] 10.222.0.16 () {58 vars in 1238 bytes} [Wed Jun 22 09:15:01 2022] DELETE /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:15:02.064955 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-09e140d7-b0eb-4997-82c3-09d2d7f3fe08 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:02.065654 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-09e140d7-b0eb-4997-82c3-09d2d7f3fe08 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:02.072032 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-09e140d7-b0eb-4997-82c3-09d2d7f3fe08 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:02.072475 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-09e140d7-b0eb-4997-82c3-09d2d7f3fe08 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:02.073283 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-09e140d7-b0eb-4997-82c3-09d2d7f3fe08 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:02.073723 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-09e140d7-b0eb-4997-82c3-09d2d7f3fe08 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:02.381640 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-09e140d7-b0eb-4997-82c3-09d2d7f3fe08 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:02.389483 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-09e140d7-b0eb-4997-82c3-09d2d7f3fe08 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.328669 Jun 22 09:15:02.390033 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 483/912] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:02 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:02.842324 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-58358cbf-e42d-4c9a-aa4f-4d01d635ce64 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:02.843340 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-58358cbf-e42d-4c9a-aa4f-4d01d635ce64 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:02.850654 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-58358cbf-e42d-4c9a-aa4f-4d01d635ce64 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:02.851103 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-58358cbf-e42d-4c9a-aa4f-4d01d635ce64 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:02.851867 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-58358cbf-e42d-4c9a-aa4f-4d01d635ce64 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:02.852303 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-58358cbf-e42d-4c9a-aa4f-4d01d635ce64 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:02.881822 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-58358cbf-e42d-4c9a-aa4f-4d01d635ce64 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043788 Jun 22 09:15:02.882371 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 430/913] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:02 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:03.406638 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-35d05b00-0be3-45ce-8be3-164f39bdc158 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:03.407158 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-35d05b00-0be3-45ce-8be3-164f39bdc158 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:03.413817 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-35d05b00-0be3-45ce-8be3-164f39bdc158 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:03.414263 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-35d05b00-0be3-45ce-8be3-164f39bdc158 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:03.415025 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-35d05b00-0be3-45ce-8be3-164f39bdc158 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:03.415458 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-35d05b00-0be3-45ce-8be3-164f39bdc158 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:03.543894 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-35d05b00-0be3-45ce-8be3-164f39bdc158 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:03.552344 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-35d05b00-0be3-45ce-8be3-164f39bdc158 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149896 Jun 22 09:15:03.552932 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 484/914] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:03 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:03.893990 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-eb676576-da17-4065-9cf8-199ccb6fca21 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:03.894908 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-eb676576-da17-4065-9cf8-199ccb6fca21 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:03.901337 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-eb676576-da17-4065-9cf8-199ccb6fca21 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:03.901790 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-eb676576-da17-4065-9cf8-199ccb6fca21 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:03.902906 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-eb676576-da17-4065-9cf8-199ccb6fca21 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:03.903604 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-eb676576-da17-4065-9cf8-199ccb6fca21 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:03.933770 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-eb676576-da17-4065-9cf8-199ccb6fca21 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044015 Jun 22 09:15:03.934317 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 431/915] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:03 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:04.570080 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-881a99e7-4e9b-4b71-94fe-68db76e05ffe tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:04.570694 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-881a99e7-4e9b-4b71-94fe-68db76e05ffe tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:04.577164 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-881a99e7-4e9b-4b71-94fe-68db76e05ffe tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:04.577887 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-881a99e7-4e9b-4b71-94fe-68db76e05ffe tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:04.578654 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-881a99e7-4e9b-4b71-94fe-68db76e05ffe tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:04.579092 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-881a99e7-4e9b-4b71-94fe-68db76e05ffe tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:04.707943 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-881a99e7-4e9b-4b71-94fe-68db76e05ffe tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:04.715874 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-881a99e7-4e9b-4b71-94fe-68db76e05ffe tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149632 Jun 22 09:15:04.716435 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 485/916] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:04 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:04.946064 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f4299d56-edc4-41e0-9ead-a844443cf220 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:04.946989 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f4299d56-edc4-41e0-9ead-a844443cf220 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:04.953407 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f4299d56-edc4-41e0-9ead-a844443cf220 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:04.953866 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f4299d56-edc4-41e0-9ead-a844443cf220 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:04.954634 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f4299d56-edc4-41e0-9ead-a844443cf220 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:04.955079 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f4299d56-edc4-41e0-9ead-a844443cf220 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:04.984792 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f4299d56-edc4-41e0-9ead-a844443cf220 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042674 Jun 22 09:15:04.985366 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 432/917] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:04 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:05.733390 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a4aca35b-a823-4dc9-aa0b-f05511dd110d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:05.733998 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-a4aca35b-a823-4dc9-aa0b-f05511dd110d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:05.740939 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a4aca35b-a823-4dc9-aa0b-f05511dd110d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:05.741390 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a4aca35b-a823-4dc9-aa0b-f05511dd110d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:05.742149 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a4aca35b-a823-4dc9-aa0b-f05511dd110d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:05.742577 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a4aca35b-a823-4dc9-aa0b-f05511dd110d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:05.869569 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-a4aca35b-a823-4dc9-aa0b-f05511dd110d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:05.877678 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a4aca35b-a823-4dc9-aa0b-f05511dd110d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.148062 Jun 22 09:15:05.878246 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 486/918] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:05 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:05.997249 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-68ba1ad2-c96e-4c52-bba1-c153b13f92f2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:05.998261 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-68ba1ad2-c96e-4c52-bba1-c153b13f92f2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:06.005398 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-68ba1ad2-c96e-4c52-bba1-c153b13f92f2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:06.005761 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-68ba1ad2-c96e-4c52-bba1-c153b13f92f2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:06.006586 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-68ba1ad2-c96e-4c52-bba1-c153b13f92f2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:06.007027 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-68ba1ad2-c96e-4c52-bba1-c153b13f92f2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:06.039351 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-68ba1ad2-c96e-4c52-bba1-c153b13f92f2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046112 Jun 22 09:15:06.039901 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 433/919] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:05 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:06.894912 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-37ebae56-41d3-48d9-b3ce-ce5cc591be64 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:06.895591 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-37ebae56-41d3-48d9-b3ce-ce5cc591be64 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:06.902273 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-37ebae56-41d3-48d9-b3ce-ce5cc591be64 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:06.902718 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-37ebae56-41d3-48d9-b3ce-ce5cc591be64 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:06.903759 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-37ebae56-41d3-48d9-b3ce-ce5cc591be64 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:06.904192 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-37ebae56-41d3-48d9-b3ce-ce5cc591be64 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:07.047266 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-37ebae56-41d3-48d9-b3ce-ce5cc591be64 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:07.051533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-01906d17-b440-4a81-b834-dc81396653a2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:07.053212 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-01906d17-b440-4a81-b834-dc81396653a2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:07.056490 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-37ebae56-41d3-48d9-b3ce-ce5cc591be64 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.165656 Jun 22 09:15:07.063945 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 487/920] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:06 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:07.064143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-01906d17-b440-4a81-b834-dc81396653a2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:07.064143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-01906d17-b440-4a81-b834-dc81396653a2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:07.064143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-01906d17-b440-4a81-b834-dc81396653a2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:07.064143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-01906d17-b440-4a81-b834-dc81396653a2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:07.093689 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-01906d17-b440-4a81-b834-dc81396653a2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046618 Jun 22 09:15:07.094247 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 434/921] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:07 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:08.074006 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-db7a72d7-de45-4e93-bb25-cf03fb77fe43 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:08.074711 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-db7a72d7-de45-4e93-bb25-cf03fb77fe43 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:08.082445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-db7a72d7-de45-4e93-bb25-cf03fb77fe43 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:08.082907 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-db7a72d7-de45-4e93-bb25-cf03fb77fe43 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:08.083676 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-db7a72d7-de45-4e93-bb25-cf03fb77fe43 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:08.084123 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-db7a72d7-de45-4e93-bb25-cf03fb77fe43 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:08.105168 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-459ea7e1-404b-4790-9db7-54422641b921 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:08.106341 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-459ea7e1-404b-4790-9db7-54422641b921 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:08.113062 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-459ea7e1-404b-4790-9db7-54422641b921 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:08.113518 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-459ea7e1-404b-4790-9db7-54422641b921 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:08.114287 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-459ea7e1-404b-4790-9db7-54422641b921 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:08.114728 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-459ea7e1-404b-4790-9db7-54422641b921 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:08.118752 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:08.148352 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-459ea7e1-404b-4790-9db7-54422641b921 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046941 Jun 22 09:15:08.149077 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 435/922] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:08 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:15:08.217225 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-db7a72d7-de45-4e93-bb25-cf03fb77fe43 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:08.219422 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=100 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:08.231176 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-db7a72d7-de45-4e93-bb25-cf03fb77fe43 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.157031 Jun 22 09:15:08.231176 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 488/923] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:08 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:09.159896 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-96c549a5-b084-46af-8d57-a81ae9529ae2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:09.161017 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-96c549a5-b084-46af-8d57-a81ae9529ae2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:09.168252 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-96c549a5-b084-46af-8d57-a81ae9529ae2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:09.174789 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-96c549a5-b084-46af-8d57-a81ae9529ae2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:09.174789 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-96c549a5-b084-46af-8d57-a81ae9529ae2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:09.174789 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-96c549a5-b084-46af-8d57-a81ae9529ae2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:09.200364 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-96c549a5-b084-46af-8d57-a81ae9529ae2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044688 Jun 22 09:15:09.200959 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 436/924] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:09 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:09.246474 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-60e242c0-0f59-414e-af9d-b460119a743e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:09.247089 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-60e242c0-0f59-414e-af9d-b460119a743e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:09.254852 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-60e242c0-0f59-414e-af9d-b460119a743e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:09.255303 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-60e242c0-0f59-414e-af9d-b460119a743e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:09.256068 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-60e242c0-0f59-414e-af9d-b460119a743e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:09.256505 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-60e242c0-0f59-414e-af9d-b460119a743e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:09.391534 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-60e242c0-0f59-414e-af9d-b460119a743e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:09.400196 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-60e242c0-0f59-414e-af9d-b460119a743e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.157583 Jun 22 09:15:09.400760 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 489/925] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:09 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:10.218350 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-2084f0a0-cb62-4ec2-b107-79b58b4aab8b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:10.219291 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-2084f0a0-cb62-4ec2-b107-79b58b4aab8b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:10.226617 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2084f0a0-cb62-4ec2-b107-79b58b4aab8b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:10.227062 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2084f0a0-cb62-4ec2-b107-79b58b4aab8b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:10.227824 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2084f0a0-cb62-4ec2-b107-79b58b4aab8b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:10.228256 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2084f0a0-cb62-4ec2-b107-79b58b4aab8b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:10.256475 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-2084f0a0-cb62-4ec2-b107-79b58b4aab8b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042384 Jun 22 09:15:10.257048 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 437/926] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:10 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:15:10.417465 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-eeb9b529-7d63-44e9-a8a8-4665e2f466c4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:10.418004 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-eeb9b529-7d63-44e9-a8a8-4665e2f466c4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:10.420237 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=40 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:10.424959 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eeb9b529-7d63-44e9-a8a8-4665e2f466c4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:10.444608 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eeb9b529-7d63-44e9-a8a8-4665e2f466c4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:10.444608 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eeb9b529-7d63-44e9-a8a8-4665e2f466c4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:10.444608 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eeb9b529-7d63-44e9-a8a8-4665e2f466c4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:10.554447 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-eeb9b529-7d63-44e9-a8a8-4665e2f466c4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:10.562388 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-eeb9b529-7d63-44e9-a8a8-4665e2f466c4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.148831 Jun 22 09:15:10.562943 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 490/927] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:10 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:11.267861 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-75bb0e4c-0d80-41cb-aab6-188e472fa5c2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:11.268951 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-75bb0e4c-0d80-41cb-aab6-188e472fa5c2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:11.275420 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-75bb0e4c-0d80-41cb-aab6-188e472fa5c2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:11.275946 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-75bb0e4c-0d80-41cb-aab6-188e472fa5c2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:11.276834 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-75bb0e4c-0d80-41cb-aab6-188e472fa5c2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:11.277343 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-75bb0e4c-0d80-41cb-aab6-188e472fa5c2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:11.307220 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-75bb0e4c-0d80-41cb-aab6-188e472fa5c2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043379 Jun 22 09:15:11.307769 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 438/928] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:11 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:15:11.579904 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-38284f6a-8098-46a3-b619-f117f2a49d87 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:11.580592 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-38284f6a-8098-46a3-b619-f117f2a49d87 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:11.586999 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-38284f6a-8098-46a3-b619-f117f2a49d87 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:11.587438 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-38284f6a-8098-46a3-b619-f117f2a49d87 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:11.588190 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-38284f6a-8098-46a3-b619-f117f2a49d87 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:11.588620 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-38284f6a-8098-46a3-b619-f117f2a49d87 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:11.718002 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-38284f6a-8098-46a3-b619-f117f2a49d87 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:11.726611 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-38284f6a-8098-46a3-b619-f117f2a49d87 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.150632 Jun 22 09:15:11.727164 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 491/929] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:11 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:12.318812 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-97c5aaf3-8927-43f5-b154-5de1aac348da tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:12.319953 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-97c5aaf3-8927-43f5-b154-5de1aac348da tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:12.326213 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-97c5aaf3-8927-43f5-b154-5de1aac348da tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:12.326666 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-97c5aaf3-8927-43f5-b154-5de1aac348da tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:12.327425 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-97c5aaf3-8927-43f5-b154-5de1aac348da tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:12.327871 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-97c5aaf3-8927-43f5-b154-5de1aac348da tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:12.356183 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-97c5aaf3-8927-43f5-b154-5de1aac348da tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041346 Jun 22 09:15:12.356749 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 439/930] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:12 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:12.743462 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9e0ba744-a707-49af-96ec-77aa3854a0fc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:12.744069 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9e0ba744-a707-49af-96ec-77aa3854a0fc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:12.750571 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9e0ba744-a707-49af-96ec-77aa3854a0fc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:12.751015 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9e0ba744-a707-49af-96ec-77aa3854a0fc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:12.751767 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9e0ba744-a707-49af-96ec-77aa3854a0fc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:12.752201 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9e0ba744-a707-49af-96ec-77aa3854a0fc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:12.878389 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9e0ba744-a707-49af-96ec-77aa3854a0fc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:12.886285 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9e0ba744-a707-49af-96ec-77aa3854a0fc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.146724 Jun 22 09:15:12.886833 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 492/931] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:12 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:13.369012 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3d9d8845-7e0c-425c-a6d7-7128bb86196b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:13.369012 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3d9d8845-7e0c-425c-a6d7-7128bb86196b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:13.371303 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:13.377754 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3d9d8845-7e0c-425c-a6d7-7128bb86196b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:13.378242 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3d9d8845-7e0c-425c-a6d7-7128bb86196b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:13.378969 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3d9d8845-7e0c-425c-a6d7-7128bb86196b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:13.379408 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3d9d8845-7e0c-425c-a6d7-7128bb86196b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:13.410529 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3d9d8845-7e0c-425c-a6d7-7128bb86196b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046425 Jun 22 09:15:13.411095 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 440/932] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:13 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:13.903982 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-fbc87250-2c48-4e1d-af21-522c1ef11b65 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:13.904530 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-fbc87250-2c48-4e1d-af21-522c1ef11b65 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:13.911850 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fbc87250-2c48-4e1d-af21-522c1ef11b65 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:13.912295 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fbc87250-2c48-4e1d-af21-522c1ef11b65 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:13.913077 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fbc87250-2c48-4e1d-af21-522c1ef11b65 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:13.913509 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fbc87250-2c48-4e1d-af21-522c1ef11b65 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:14.039617 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-fbc87250-2c48-4e1d-af21-522c1ef11b65 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:14.047815 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-fbc87250-2c48-4e1d-af21-522c1ef11b65 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.148335 Jun 22 09:15:14.048371 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 493/933] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:13 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:14.422278 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-8438ad2f-4ded-441b-8c2c-432dd12e8d94 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:14.423276 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-8438ad2f-4ded-441b-8c2c-432dd12e8d94 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:14.430432 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8438ad2f-4ded-441b-8c2c-432dd12e8d94 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:14.430885 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8438ad2f-4ded-441b-8c2c-432dd12e8d94 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:14.432028 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8438ad2f-4ded-441b-8c2c-432dd12e8d94 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:14.432481 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8438ad2f-4ded-441b-8c2c-432dd12e8d94 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:14.463466 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-8438ad2f-4ded-441b-8c2c-432dd12e8d94 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045658 Jun 22 09:15:14.464024 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 441/934] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:14 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:15:15.065120 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-da9cbde7-7d19-466e-93dd-401e91d204ff tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:15.065744 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-da9cbde7-7d19-466e-93dd-401e91d204ff tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:15.072290 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-da9cbde7-7d19-466e-93dd-401e91d204ff tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:15.072745 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-da9cbde7-7d19-466e-93dd-401e91d204ff tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:15.073541 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-da9cbde7-7d19-466e-93dd-401e91d204ff tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:15.073986 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-da9cbde7-7d19-466e-93dd-401e91d204ff tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:15.208114 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-da9cbde7-7d19-466e-93dd-401e91d204ff tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:15.216200 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-da9cbde7-7d19-466e-93dd-401e91d204ff tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.155425 Jun 22 09:15:15.216773 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 494/935] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:15 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:15.475977 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a27f573b-f8a9-41cf-a3b8-be29f85ab97a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:15.476941 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a27f573b-f8a9-41cf-a3b8-be29f85ab97a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:15.483430 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a27f573b-f8a9-41cf-a3b8-be29f85ab97a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:15.483888 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a27f573b-f8a9-41cf-a3b8-be29f85ab97a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:15.484684 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a27f573b-f8a9-41cf-a3b8-be29f85ab97a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:15.485155 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a27f573b-f8a9-41cf-a3b8-be29f85ab97a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:15.514102 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a27f573b-f8a9-41cf-a3b8-be29f85ab97a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042082 Jun 22 09:15:15.514651 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 442/936] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:15 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:16.233704 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-ed8fba7a-89f6-4267-ba2c-d395dbeb7e20 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:16.234320 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-ed8fba7a-89f6-4267-ba2c-d395dbeb7e20 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:16.241139 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ed8fba7a-89f6-4267-ba2c-d395dbeb7e20 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:16.241619 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ed8fba7a-89f6-4267-ba2c-d395dbeb7e20 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:16.242381 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ed8fba7a-89f6-4267-ba2c-d395dbeb7e20 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:16.242819 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ed8fba7a-89f6-4267-ba2c-d395dbeb7e20 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:16.369204 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-ed8fba7a-89f6-4267-ba2c-d395dbeb7e20 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:16.377841 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-ed8fba7a-89f6-4267-ba2c-d395dbeb7e20 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.147865 Jun 22 09:15:16.378761 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 495/937] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:16 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:16.526224 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-04cb4e66-b0f8-4f45-bf30-96f0dd10cc72 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:16.527141 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-04cb4e66-b0f8-4f45-bf30-96f0dd10cc72 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:16.534556 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-04cb4e66-b0f8-4f45-bf30-96f0dd10cc72 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:16.535004 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-04cb4e66-b0f8-4f45-bf30-96f0dd10cc72 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:16.535766 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-04cb4e66-b0f8-4f45-bf30-96f0dd10cc72 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:16.536203 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-04cb4e66-b0f8-4f45-bf30-96f0dd10cc72 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:16.564828 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-04cb4e66-b0f8-4f45-bf30-96f0dd10cc72 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042496 Jun 22 09:15:16.565383 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 443/938] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:16 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:17.395337 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-19cdf29e-2ebc-476f-a8bd-575bc895ef1f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:17.395955 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-19cdf29e-2ebc-476f-a8bd-575bc895ef1f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:17.403111 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-19cdf29e-2ebc-476f-a8bd-575bc895ef1f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:17.407416 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-19cdf29e-2ebc-476f-a8bd-575bc895ef1f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:17.407416 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-19cdf29e-2ebc-476f-a8bd-575bc895ef1f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:17.407416 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-19cdf29e-2ebc-476f-a8bd-575bc895ef1f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:17.538140 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-19cdf29e-2ebc-476f-a8bd-575bc895ef1f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:17.546069 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-19cdf29e-2ebc-476f-a8bd-575bc895ef1f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.155309 Jun 22 09:15:17.546642 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 496/939] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:17 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:17.575395 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-2b4754d2-198a-4f6b-a993-02cb98a68488 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:17.576311 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-2b4754d2-198a-4f6b-a993-02cb98a68488 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:17.583478 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2b4754d2-198a-4f6b-a993-02cb98a68488 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:17.583918 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2b4754d2-198a-4f6b-a993-02cb98a68488 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:17.584673 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2b4754d2-198a-4f6b-a993-02cb98a68488 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:17.585133 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2b4754d2-198a-4f6b-a993-02cb98a68488 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:17.614727 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-2b4754d2-198a-4f6b-a993-02cb98a68488 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043193 Jun 22 09:15:17.615272 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 444/940] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:17 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:18.563430 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-5440c534-4705-4966-b2ec-d6fde38b34f6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:18.564653 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-5440c534-4705-4966-b2ec-d6fde38b34f6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:18.571140 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5440c534-4705-4966-b2ec-d6fde38b34f6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:18.571592 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5440c534-4705-4966-b2ec-d6fde38b34f6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:18.572353 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5440c534-4705-4966-b2ec-d6fde38b34f6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:18.572822 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5440c534-4705-4966-b2ec-d6fde38b34f6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:18.627208 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-d498d51b-da13-4aa3-a780-32e9f01e0259 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:18.628264 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-d498d51b-da13-4aa3-a780-32e9f01e0259 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:18.634531 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d498d51b-da13-4aa3-a780-32e9f01e0259 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:18.634977 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d498d51b-da13-4aa3-a780-32e9f01e0259 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:18.635745 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d498d51b-da13-4aa3-a780-32e9f01e0259 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:18.636190 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d498d51b-da13-4aa3-a780-32e9f01e0259 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:18.667201 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-d498d51b-da13-4aa3-a780-32e9f01e0259 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044555 Jun 22 09:15:18.667804 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 445/941] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:18 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:15:18.703302 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-5440c534-4705-4966-b2ec-d6fde38b34f6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:18.711792 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-5440c534-4705-4966-b2ec-d6fde38b34f6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.152318 Jun 22 09:15:18.712350 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 497/942] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:18 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:19.679195 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-266a7ddb-c24c-4027-9c07-a8530b0e2380 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:19.680116 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-266a7ddb-c24c-4027-9c07-a8530b0e2380 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:19.686497 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-266a7ddb-c24c-4027-9c07-a8530b0e2380 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:19.686947 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-266a7ddb-c24c-4027-9c07-a8530b0e2380 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:19.687701 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-266a7ddb-c24c-4027-9c07-a8530b0e2380 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:19.688138 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-266a7ddb-c24c-4027-9c07-a8530b0e2380 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:19.716395 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-266a7ddb-c24c-4027-9c07-a8530b0e2380 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041102 Jun 22 09:15:19.716983 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 446/943] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:19 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:19.729236 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-62badf09-3a63-4dff-b85c-a74ba90d812d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:19.729846 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-62badf09-3a63-4dff-b85c-a74ba90d812d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:19.737411 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-62badf09-3a63-4dff-b85c-a74ba90d812d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:19.737855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-62badf09-3a63-4dff-b85c-a74ba90d812d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:19.738609 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-62badf09-3a63-4dff-b85c-a74ba90d812d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:19.739041 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-62badf09-3a63-4dff-b85c-a74ba90d812d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:19.863421 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-62badf09-3a63-4dff-b85c-a74ba90d812d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:19.872159 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-62badf09-3a63-4dff-b85c-a74ba90d812d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.146744 Jun 22 09:15:19.872726 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 498/944] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:19 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:15:20.727597 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-5c366909-c3d1-45aa-8235-59980cae5d21 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:20.728522 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-5c366909-c3d1-45aa-8235-59980cae5d21 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:20.734649 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5c366909-c3d1-45aa-8235-59980cae5d21 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:20.735098 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5c366909-c3d1-45aa-8235-59980cae5d21 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:20.736490 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5c366909-c3d1-45aa-8235-59980cae5d21 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:20.736962 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5c366909-c3d1-45aa-8235-59980cae5d21 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:20.765555 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-5c366909-c3d1-45aa-8235-59980cae5d21 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042068 Jun 22 09:15:20.766099 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 447/945] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:20 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:20.889467 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-6c0e946d-508b-40d7-bd88-b76b5d652b13 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:20.890013 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-6c0e946d-508b-40d7-bd88-b76b5d652b13 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:20.896647 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6c0e946d-508b-40d7-bd88-b76b5d652b13 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:20.897172 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6c0e946d-508b-40d7-bd88-b76b5d652b13 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:20.897936 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6c0e946d-508b-40d7-bd88-b76b5d652b13 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:20.898371 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6c0e946d-508b-40d7-bd88-b76b5d652b13 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:21.028537 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-6c0e946d-508b-40d7-bd88-b76b5d652b13 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:21.037600 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-6c0e946d-508b-40d7-bd88-b76b5d652b13 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.152119 Jun 22 09:15:21.038169 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 499/946] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:20 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:21.776977 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-51a8f6e5-b057-4b82-a9d7-3c856588b46b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:21.778215 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-51a8f6e5-b057-4b82-a9d7-3c856588b46b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:21.785490 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-51a8f6e5-b057-4b82-a9d7-3c856588b46b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:21.785946 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-51a8f6e5-b057-4b82-a9d7-3c856588b46b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:21.786709 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-51a8f6e5-b057-4b82-a9d7-3c856588b46b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:21.787150 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-51a8f6e5-b057-4b82-a9d7-3c856588b46b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:21.815970 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-51a8f6e5-b057-4b82-a9d7-3c856588b46b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042978 Jun 22 09:15:21.816518 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 448/947] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:21 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:22.054693 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7cafb40e-6dd0-4a7c-9fe9-08b5ba2ede4e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:22.055317 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7cafb40e-6dd0-4a7c-9fe9-08b5ba2ede4e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:22.061621 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7cafb40e-6dd0-4a7c-9fe9-08b5ba2ede4e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:22.062116 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7cafb40e-6dd0-4a7c-9fe9-08b5ba2ede4e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:22.062882 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7cafb40e-6dd0-4a7c-9fe9-08b5ba2ede4e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:22.063319 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7cafb40e-6dd0-4a7c-9fe9-08b5ba2ede4e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:22.193311 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7cafb40e-6dd0-4a7c-9fe9-08b5ba2ede4e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:22.201170 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7cafb40e-6dd0-4a7c-9fe9-08b5ba2ede4e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.150341 Jun 22 09:15:22.201727 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 500/948] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:22 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:22.827363 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a489aec5-9887-4ad4-81cc-bb47007bb482 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:22.828288 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a489aec5-9887-4ad4-81cc-bb47007bb482 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:22.835386 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a489aec5-9887-4ad4-81cc-bb47007bb482 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:22.835830 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a489aec5-9887-4ad4-81cc-bb47007bb482 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:22.836592 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a489aec5-9887-4ad4-81cc-bb47007bb482 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:22.837055 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a489aec5-9887-4ad4-81cc-bb47007bb482 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:22.865041 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a489aec5-9887-4ad4-81cc-bb47007bb482 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041622 Jun 22 09:15:22.865597 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 449/949] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:22 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:23.218425 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-343adfec-a897-4fa2-9581-1e87d5a6ae64 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:23.219080 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-343adfec-a897-4fa2-9581-1e87d5a6ae64 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:23.226119 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-343adfec-a897-4fa2-9581-1e87d5a6ae64 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:23.226573 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-343adfec-a897-4fa2-9581-1e87d5a6ae64 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:23.227337 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-343adfec-a897-4fa2-9581-1e87d5a6ae64 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:23.227786 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-343adfec-a897-4fa2-9581-1e87d5a6ae64 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:23.360172 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-343adfec-a897-4fa2-9581-1e87d5a6ae64 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:23.369012 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-343adfec-a897-4fa2-9581-1e87d5a6ae64 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.154148 Jun 22 09:15:23.369586 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 501/950] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:23 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:23.876355 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f51ffdcf-63cf-49cc-a352-5e536bc4e1af tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:23.877266 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f51ffdcf-63cf-49cc-a352-5e536bc4e1af tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:23.883673 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f51ffdcf-63cf-49cc-a352-5e536bc4e1af tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:23.884117 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f51ffdcf-63cf-49cc-a352-5e536bc4e1af tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:23.884900 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f51ffdcf-63cf-49cc-a352-5e536bc4e1af tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:23.885337 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f51ffdcf-63cf-49cc-a352-5e536bc4e1af tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:23.914528 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f51ffdcf-63cf-49cc-a352-5e536bc4e1af tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042071 Jun 22 09:15:23.914998 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 450/951] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:23 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:24.386253 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-8971aa44-247c-475a-a948-c5a61c2c28e6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:24.386866 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-8971aa44-247c-475a-a948-c5a61c2c28e6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:24.394053 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8971aa44-247c-475a-a948-c5a61c2c28e6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:24.394499 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8971aa44-247c-475a-a948-c5a61c2c28e6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:24.395258 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8971aa44-247c-475a-a948-c5a61c2c28e6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:24.395693 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8971aa44-247c-475a-a948-c5a61c2c28e6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:24.523064 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-8971aa44-247c-475a-a948-c5a61c2c28e6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:24.531159 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-8971aa44-247c-475a-a948-c5a61c2c28e6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.148765 Jun 22 09:15:24.531711 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 502/952] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:24 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:24.925963 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-d748f973-e0bd-4794-bfa4-953ecc276460 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:24.926929 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-d748f973-e0bd-4794-bfa4-953ecc276460 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:24.933443 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d748f973-e0bd-4794-bfa4-953ecc276460 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:24.933897 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d748f973-e0bd-4794-bfa4-953ecc276460 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:24.934661 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d748f973-e0bd-4794-bfa4-953ecc276460 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:24.935105 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d748f973-e0bd-4794-bfa4-953ecc276460 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:24.961456 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=100 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:24.966199 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-d748f973-e0bd-4794-bfa4-953ecc276460 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044358 Jun 22 09:15:24.966994 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 451/953] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:24 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:25.548662 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-3dea2d40-12c9-43f4-a6ff-80c53eecb601 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:25.549574 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-3dea2d40-12c9-43f4-a6ff-80c53eecb601 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:25.555974 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3dea2d40-12c9-43f4-a6ff-80c53eecb601 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:25.556423 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3dea2d40-12c9-43f4-a6ff-80c53eecb601 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:25.557219 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3dea2d40-12c9-43f4-a6ff-80c53eecb601 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:25.557660 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3dea2d40-12c9-43f4-a6ff-80c53eecb601 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:25.686727 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-3dea2d40-12c9-43f4-a6ff-80c53eecb601 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:25.695257 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-3dea2d40-12c9-43f4-a6ff-80c53eecb601 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.151276 Jun 22 09:15:25.695823 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 503/954] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:25 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:25.981812 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-17ee6010-5398-4d23-bd2f-f2d6f864998d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:25.982723 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-17ee6010-5398-4d23-bd2f-f2d6f864998d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:25.989321 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-17ee6010-5398-4d23-bd2f-f2d6f864998d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:25.989767 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-17ee6010-5398-4d23-bd2f-f2d6f864998d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:25.990516 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-17ee6010-5398-4d23-bd2f-f2d6f864998d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:25.990950 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-17ee6010-5398-4d23-bd2f-f2d6f864998d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:26.019979 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-17ee6010-5398-4d23-bd2f-f2d6f864998d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042413 Jun 22 09:15:26.020528 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 452/955] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:25 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:26.712424 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9aaa1e74-d7cf-4f31-aaa1-7ef4ec89ca94 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:26.713102 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9aaa1e74-d7cf-4f31-aaa1-7ef4ec89ca94 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:26.719548 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9aaa1e74-d7cf-4f31-aaa1-7ef4ec89ca94 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:26.720648 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9aaa1e74-d7cf-4f31-aaa1-7ef4ec89ca94 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:26.721436 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9aaa1e74-d7cf-4f31-aaa1-7ef4ec89ca94 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:26.721872 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9aaa1e74-d7cf-4f31-aaa1-7ef4ec89ca94 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:26.848329 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9aaa1e74-d7cf-4f31-aaa1-7ef4ec89ca94 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:26.856312 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9aaa1e74-d7cf-4f31-aaa1-7ef4ec89ca94 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.147733 Jun 22 09:15:26.856890 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 504/956] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:26 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:27.034114 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-130d104f-9c36-46b5-846e-7bfb3c07d610 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:27.055403 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-130d104f-9c36-46b5-846e-7bfb3c07d610 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:27.055403 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-130d104f-9c36-46b5-846e-7bfb3c07d610 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:27.055403 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-130d104f-9c36-46b5-846e-7bfb3c07d610 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:27.055403 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-130d104f-9c36-46b5-846e-7bfb3c07d610 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:27.055876 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-130d104f-9c36-46b5-846e-7bfb3c07d610 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:27.078164 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-130d104f-9c36-46b5-846e-7bfb3c07d610 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049525 Jun 22 09:15:27.078718 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 453/957] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:27 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:27.873247 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a864436f-2f3a-46e9-8a25-568f9bc73656 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:27.873864 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-a864436f-2f3a-46e9-8a25-568f9bc73656 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:27.881230 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a864436f-2f3a-46e9-8a25-568f9bc73656 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:27.881681 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a864436f-2f3a-46e9-8a25-568f9bc73656 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:27.882483 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a864436f-2f3a-46e9-8a25-568f9bc73656 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:27.882919 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a864436f-2f3a-46e9-8a25-568f9bc73656 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:27.898934 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=100 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:28.013047 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-a864436f-2f3a-46e9-8a25-568f9bc73656 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:28.021655 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a864436f-2f3a-46e9-8a25-568f9bc73656 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.152239 Jun 22 09:15:28.022208 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 505/958] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:27 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:28.089766 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c1475ce1-78fa-45ab-bfc6-292fd04fa25c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:28.090714 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c1475ce1-78fa-45ab-bfc6-292fd04fa25c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:28.097207 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c1475ce1-78fa-45ab-bfc6-292fd04fa25c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:28.097656 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c1475ce1-78fa-45ab-bfc6-292fd04fa25c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:28.098414 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c1475ce1-78fa-45ab-bfc6-292fd04fa25c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:28.098848 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c1475ce1-78fa-45ab-bfc6-292fd04fa25c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:28.127556 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c1475ce1-78fa-45ab-bfc6-292fd04fa25c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041645 Jun 22 09:15:28.128024 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 454/959] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:28 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:29.038708 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-b0a51e01-c65a-46fd-9d2f-83bd942284d1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:29.039325 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-b0a51e01-c65a-46fd-9d2f-83bd942284d1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:29.045769 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b0a51e01-c65a-46fd-9d2f-83bd942284d1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:29.046226 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b0a51e01-c65a-46fd-9d2f-83bd942284d1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:29.046996 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b0a51e01-c65a-46fd-9d2f-83bd942284d1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:29.047456 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b0a51e01-c65a-46fd-9d2f-83bd942284d1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:29.138984 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-51894adc-1080-469d-8d53-3733b7f7fc3f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:29.139942 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-51894adc-1080-469d-8d53-3733b7f7fc3f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:29.146620 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-51894adc-1080-469d-8d53-3733b7f7fc3f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:29.147069 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-51894adc-1080-469d-8d53-3733b7f7fc3f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:29.147838 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-51894adc-1080-469d-8d53-3733b7f7fc3f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:29.148273 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-51894adc-1080-469d-8d53-3733b7f7fc3f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:29.177310 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-51894adc-1080-469d-8d53-3733b7f7fc3f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042158 Jun 22 09:15:29.178219 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 455/960] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:29 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:15:29.180361 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-b0a51e01-c65a-46fd-9d2f-83bd942284d1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:29.189059 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-b0a51e01-c65a-46fd-9d2f-83bd942284d1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.153420 Jun 22 09:15:29.189739 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 506/961] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:29 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:30.189233 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-70b31794-d199-4725-87b8-768301c0da8c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:30.190159 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-70b31794-d199-4725-87b8-768301c0da8c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:30.196893 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-70b31794-d199-4725-87b8-768301c0da8c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:30.197361 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-70b31794-d199-4725-87b8-768301c0da8c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:30.198154 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-70b31794-d199-4725-87b8-768301c0da8c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:30.198589 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-70b31794-d199-4725-87b8-768301c0da8c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:30.206926 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-78e0d69b-1d41-4c63-9c1f-9f95b5313104 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:30.207550 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-78e0d69b-1d41-4c63-9c1f-9f95b5313104 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:30.214238 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-78e0d69b-1d41-4c63-9c1f-9f95b5313104 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:30.214695 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-78e0d69b-1d41-4c63-9c1f-9f95b5313104 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:30.215470 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-78e0d69b-1d41-4c63-9c1f-9f95b5313104 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:30.216081 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-78e0d69b-1d41-4c63-9c1f-9f95b5313104 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:30.227999 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-70b31794-d199-4725-87b8-768301c0da8c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042935 Jun 22 09:15:30.228559 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 456/962] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:30 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:30.342576 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-78e0d69b-1d41-4c63-9c1f-9f95b5313104 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:30.353233 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-78e0d69b-1d41-4c63-9c1f-9f95b5313104 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.150838 Jun 22 09:15:30.353799 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 507/963] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:30 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:15:31.240168 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c5484c56-9884-4d2d-8265-6c91550e19a0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:31.241165 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c5484c56-9884-4d2d-8265-6c91550e19a0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:31.247668 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c5484c56-9884-4d2d-8265-6c91550e19a0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:31.248119 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c5484c56-9884-4d2d-8265-6c91550e19a0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:31.248920 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c5484c56-9884-4d2d-8265-6c91550e19a0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:31.249359 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c5484c56-9884-4d2d-8265-6c91550e19a0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:31.279135 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c5484c56-9884-4d2d-8265-6c91550e19a0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042900 Jun 22 09:15:31.279724 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 457/964] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:31 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:31.371199 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-6cee78d5-bb40-454f-9bd5-54577819fa6d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:31.371735 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-6cee78d5-bb40-454f-9bd5-54577819fa6d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:31.379042 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6cee78d5-bb40-454f-9bd5-54577819fa6d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:31.379485 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6cee78d5-bb40-454f-9bd5-54577819fa6d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:31.380240 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6cee78d5-bb40-454f-9bd5-54577819fa6d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:31.380668 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6cee78d5-bb40-454f-9bd5-54577819fa6d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:31.519579 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-6cee78d5-bb40-454f-9bd5-54577819fa6d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:31.528629 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-6cee78d5-bb40-454f-9bd5-54577819fa6d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.161374 Jun 22 09:15:31.529230 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 508/965] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:31 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:32.290775 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-25843f35-6828-4943-a955-efec0b659c40 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:32.291689 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-25843f35-6828-4943-a955-efec0b659c40 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:32.298935 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-25843f35-6828-4943-a955-efec0b659c40 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:32.299432 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-25843f35-6828-4943-a955-efec0b659c40 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:32.300198 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-25843f35-6828-4943-a955-efec0b659c40 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:32.300632 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-25843f35-6828-4943-a955-efec0b659c40 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:32.329831 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-25843f35-6828-4943-a955-efec0b659c40 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042959 Jun 22 09:15:32.330394 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 458/966] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:32 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:32.546581 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2207c960-cf56-4abb-a588-ee6ddac7e127 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:32.547189 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2207c960-cf56-4abb-a588-ee6ddac7e127 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:32.555092 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2207c960-cf56-4abb-a588-ee6ddac7e127 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:32.555546 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2207c960-cf56-4abb-a588-ee6ddac7e127 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:32.556305 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2207c960-cf56-4abb-a588-ee6ddac7e127 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:32.556740 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2207c960-cf56-4abb-a588-ee6ddac7e127 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:32.688996 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-2207c960-cf56-4abb-a588-ee6ddac7e127 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:32.697138 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2207c960-cf56-4abb-a588-ee6ddac7e127 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.154553 Jun 22 09:15:32.697705 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 509/967] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:32 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:33.341366 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-2280140f-f299-4876-aa1d-ac748d05c57b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:33.342232 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-2280140f-f299-4876-aa1d-ac748d05c57b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:33.348957 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2280140f-f299-4876-aa1d-ac748d05c57b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:33.349413 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2280140f-f299-4876-aa1d-ac748d05c57b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:33.350177 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2280140f-f299-4876-aa1d-ac748d05c57b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:33.350617 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2280140f-f299-4876-aa1d-ac748d05c57b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:33.379494 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-2280140f-f299-4876-aa1d-ac748d05c57b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042096 Jun 22 09:15:33.380047 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 459/968] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:33 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:33.715091 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9a3135b0-d50d-4736-ad20-ca81b0b29253 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:33.715670 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9a3135b0-d50d-4736-ad20-ca81b0b29253 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:33.722068 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9a3135b0-d50d-4736-ad20-ca81b0b29253 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:33.722517 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9a3135b0-d50d-4736-ad20-ca81b0b29253 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:33.723277 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9a3135b0-d50d-4736-ad20-ca81b0b29253 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:33.723716 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9a3135b0-d50d-4736-ad20-ca81b0b29253 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:33.849549 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9a3135b0-d50d-4736-ad20-ca81b0b29253 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:33.857446 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9a3135b0-d50d-4736-ad20-ca81b0b29253 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.146271 Jun 22 09:15:33.857995 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 510/969] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:33 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:34.390053 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-cb5f80e0-1210-424e-8d85-6097a9a929e4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:34.390983 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-cb5f80e0-1210-424e-8d85-6097a9a929e4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:34.398134 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cb5f80e0-1210-424e-8d85-6097a9a929e4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:34.398582 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cb5f80e0-1210-424e-8d85-6097a9a929e4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:34.399341 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cb5f80e0-1210-424e-8d85-6097a9a929e4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:34.399804 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cb5f80e0-1210-424e-8d85-6097a9a929e4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:34.428730 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-cb5f80e0-1210-424e-8d85-6097a9a929e4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042615 Jun 22 09:15:34.429313 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 460/970] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:34 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:34.874989 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-acdb1b16-8972-46d9-9a62-26e990081480 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:34.876226 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-acdb1b16-8972-46d9-9a62-26e990081480 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:34.882807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-acdb1b16-8972-46d9-9a62-26e990081480 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:34.883257 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-acdb1b16-8972-46d9-9a62-26e990081480 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:34.884022 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-acdb1b16-8972-46d9-9a62-26e990081480 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:34.884460 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-acdb1b16-8972-46d9-9a62-26e990081480 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:35.015735 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-acdb1b16-8972-46d9-9a62-26e990081480 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:35.024043 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-acdb1b16-8972-46d9-9a62-26e990081480 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.152856 Jun 22 09:15:35.024614 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 511/971] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:34 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:35.439687 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-767b9450-3c8d-46ad-9769-c3a8dbe92c7f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:35.440614 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-767b9450-3c8d-46ad-9769-c3a8dbe92c7f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:35.447117 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-767b9450-3c8d-46ad-9769-c3a8dbe92c7f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:35.447571 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-767b9450-3c8d-46ad-9769-c3a8dbe92c7f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:35.448336 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-767b9450-3c8d-46ad-9769-c3a8dbe92c7f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:35.448803 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-767b9450-3c8d-46ad-9769-c3a8dbe92c7f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:35.477625 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-767b9450-3c8d-46ad-9769-c3a8dbe92c7f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041974 Jun 22 09:15:35.478099 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 461/972] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:35 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:36.041281 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-4d93362b-e75c-42a1-88d2-0ac7375798a7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:36.041960 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-4d93362b-e75c-42a1-88d2-0ac7375798a7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:36.048293 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4d93362b-e75c-42a1-88d2-0ac7375798a7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:36.048736 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4d93362b-e75c-42a1-88d2-0ac7375798a7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:36.049574 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4d93362b-e75c-42a1-88d2-0ac7375798a7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:36.050005 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4d93362b-e75c-42a1-88d2-0ac7375798a7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:36.176676 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-4d93362b-e75c-42a1-88d2-0ac7375798a7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:36.184543 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-4d93362b-e75c-42a1-88d2-0ac7375798a7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.147092 Jun 22 09:15:36.185137 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 512/973] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:36 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:36.489074 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6786b6a2-faac-40cd-88b3-f13f73c2467a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:36.490179 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-6786b6a2-faac-40cd-88b3-f13f73c2467a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:36.496635 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6786b6a2-faac-40cd-88b3-f13f73c2467a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:36.497112 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6786b6a2-faac-40cd-88b3-f13f73c2467a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:36.497871 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6786b6a2-faac-40cd-88b3-f13f73c2467a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:36.498307 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6786b6a2-faac-40cd-88b3-f13f73c2467a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:36.527069 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-6786b6a2-faac-40cd-88b3-f13f73c2467a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041719 Jun 22 09:15:36.527602 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 462/974] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:36 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:37.201767 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-6295a4a9-61b5-474e-ba4d-2a9b7ef8f018 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:37.202379 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-6295a4a9-61b5-474e-ba4d-2a9b7ef8f018 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:37.209392 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6295a4a9-61b5-474e-ba4d-2a9b7ef8f018 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:37.209842 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6295a4a9-61b5-474e-ba4d-2a9b7ef8f018 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:37.210605 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6295a4a9-61b5-474e-ba4d-2a9b7ef8f018 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:37.211043 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6295a4a9-61b5-474e-ba4d-2a9b7ef8f018 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:37.342423 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-6295a4a9-61b5-474e-ba4d-2a9b7ef8f018 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:37.350553 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-6295a4a9-61b5-474e-ba4d-2a9b7ef8f018 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.152704 Jun 22 09:15:37.351122 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 513/975] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:37 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:37.538899 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-32735136-aa34-470b-856c-c66197c58cc2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:37.539818 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-32735136-aa34-470b-856c-c66197c58cc2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:37.546181 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-32735136-aa34-470b-856c-c66197c58cc2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:37.546629 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-32735136-aa34-470b-856c-c66197c58cc2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:37.548099 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-32735136-aa34-470b-856c-c66197c58cc2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:37.548697 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-32735136-aa34-470b-856c-c66197c58cc2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:37.577161 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-32735136-aa34-470b-856c-c66197c58cc2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042132 Jun 22 09:15:37.577696 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 463/976] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:37 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:38.367501 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-01202fc4-ff83-4e7a-a006-7e97c6ecb444 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:38.368116 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-01202fc4-ff83-4e7a-a006-7e97c6ecb444 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:38.374780 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-01202fc4-ff83-4e7a-a006-7e97c6ecb444 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:38.375236 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-01202fc4-ff83-4e7a-a006-7e97c6ecb444 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:38.376491 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-01202fc4-ff83-4e7a-a006-7e97c6ecb444 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:38.376957 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-01202fc4-ff83-4e7a-a006-7e97c6ecb444 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:38.511126 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-01202fc4-ff83-4e7a-a006-7e97c6ecb444 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:38.523211 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-01202fc4-ff83-4e7a-a006-7e97c6ecb444 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.155948 Jun 22 09:15:38.523211 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 514/977] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:38 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:38.588199 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-9d49d0f1-ecd3-4f02-8c3e-865459126705 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:38.589150 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-9d49d0f1-ecd3-4f02-8c3e-865459126705 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:38.596272 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9d49d0f1-ecd3-4f02-8c3e-865459126705 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:38.596718 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9d49d0f1-ecd3-4f02-8c3e-865459126705 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:38.597495 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9d49d0f1-ecd3-4f02-8c3e-865459126705 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:38.597924 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9d49d0f1-ecd3-4f02-8c3e-865459126705 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:38.626466 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-9d49d0f1-ecd3-4f02-8c3e-865459126705 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042259 Jun 22 09:15:38.627012 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 464/978] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:38 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:15:39.537804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-55a2615b-6e7b-4f21-8037-7463cf62f856 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:39.538422 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-55a2615b-6e7b-4f21-8037-7463cf62f856 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:39.544772 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-55a2615b-6e7b-4f21-8037-7463cf62f856 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:39.545251 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-55a2615b-6e7b-4f21-8037-7463cf62f856 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:39.546014 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-55a2615b-6e7b-4f21-8037-7463cf62f856 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:39.546452 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-55a2615b-6e7b-4f21-8037-7463cf62f856 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:39.637851 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f7667c57-11fc-4bd4-aaa0-fb46270ec8f4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:39.638858 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f7667c57-11fc-4bd4-aaa0-fb46270ec8f4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:39.645672 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f7667c57-11fc-4bd4-aaa0-fb46270ec8f4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:39.646127 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f7667c57-11fc-4bd4-aaa0-fb46270ec8f4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:39.646900 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f7667c57-11fc-4bd4-aaa0-fb46270ec8f4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:39.647338 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f7667c57-11fc-4bd4-aaa0-fb46270ec8f4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:39.677132 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f7667c57-11fc-4bd4-aaa0-fb46270ec8f4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042991 Jun 22 09:15:39.677644 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 465/979] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:39 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:15:39.678005 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-55a2615b-6e7b-4f21-8037-7463cf62f856 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:39.685891 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-55a2615b-6e7b-4f21-8037-7463cf62f856 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.151858 Jun 22 09:15:39.686441 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 515/980] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:39 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:40.689264 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-98d2ffaa-48bb-4a03-a888-e958597bb946 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:40.690033 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-98d2ffaa-48bb-4a03-a888-e958597bb946 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:40.696467 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-98d2ffaa-48bb-4a03-a888-e958597bb946 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:40.696961 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-98d2ffaa-48bb-4a03-a888-e958597bb946 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:40.697728 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-98d2ffaa-48bb-4a03-a888-e958597bb946 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:40.698165 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-98d2ffaa-48bb-4a03-a888-e958597bb946 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:40.703272 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-67de115c-6d4a-476e-816e-8c50f813a9bb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:40.703891 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-67de115c-6d4a-476e-816e-8c50f813a9bb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:40.706812 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=52 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:40.711571 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-67de115c-6d4a-476e-816e-8c50f813a9bb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:40.712019 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-67de115c-6d4a-476e-816e-8c50f813a9bb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:40.712811 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-67de115c-6d4a-476e-816e-8c50f813a9bb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:40.713244 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-67de115c-6d4a-476e-816e-8c50f813a9bb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:40.728304 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-98d2ffaa-48bb-4a03-a888-e958597bb946 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043728 Jun 22 09:15:40.728824 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 466/981] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:40 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:40.842236 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-67de115c-6d4a-476e-816e-8c50f813a9bb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:40.850208 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-67de115c-6d4a-476e-816e-8c50f813a9bb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.150822 Jun 22 09:15:40.850768 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 516/982] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:40 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:41.739798 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-032ddef5-1805-484a-bd09-553b2333c458 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:41.740719 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-032ddef5-1805-484a-bd09-553b2333c458 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:41.747365 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-032ddef5-1805-484a-bd09-553b2333c458 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:41.747835 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-032ddef5-1805-484a-bd09-553b2333c458 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:41.748609 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-032ddef5-1805-484a-bd09-553b2333c458 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:41.749082 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-032ddef5-1805-484a-bd09-553b2333c458 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:41.779164 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-032ddef5-1805-484a-bd09-553b2333c458 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043220 Jun 22 09:15:41.779646 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 467/983] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:41 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:41.867247 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c62c2f12-e533-4bcf-8768-d15d48ecaf22 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:41.867857 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c62c2f12-e533-4bcf-8768-d15d48ecaf22 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:41.874335 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c62c2f12-e533-4bcf-8768-d15d48ecaf22 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:41.874783 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c62c2f12-e533-4bcf-8768-d15d48ecaf22 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:41.875544 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c62c2f12-e533-4bcf-8768-d15d48ecaf22 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:41.876756 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c62c2f12-e533-4bcf-8768-d15d48ecaf22 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:42.002536 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c62c2f12-e533-4bcf-8768-d15d48ecaf22 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:42.010466 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c62c2f12-e533-4bcf-8768-d15d48ecaf22 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.147024 Jun 22 09:15:42.011036 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 517/984] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:41 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:42.791822 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c6d25573-7725-4af3-8bc2-74b9c7777124 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:42.792748 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c6d25573-7725-4af3-8bc2-74b9c7777124 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:42.799253 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c6d25573-7725-4af3-8bc2-74b9c7777124 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:42.799712 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c6d25573-7725-4af3-8bc2-74b9c7777124 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:42.800475 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c6d25573-7725-4af3-8bc2-74b9c7777124 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:42.800949 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c6d25573-7725-4af3-8bc2-74b9c7777124 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:42.814651 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=100 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:42.831540 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c6d25573-7725-4af3-8bc2-74b9c7777124 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043624 Jun 22 09:15:42.832030 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 468/985] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:42 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:43.028155 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-5216ec28-bd83-4d01-8c79-fbaf9185ed77 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:43.028843 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-5216ec28-bd83-4d01-8c79-fbaf9185ed77 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:43.035503 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5216ec28-bd83-4d01-8c79-fbaf9185ed77 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:43.037213 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5216ec28-bd83-4d01-8c79-fbaf9185ed77 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:43.037213 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5216ec28-bd83-4d01-8c79-fbaf9185ed77 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:43.037213 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5216ec28-bd83-4d01-8c79-fbaf9185ed77 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:43.167557 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-5216ec28-bd83-4d01-8c79-fbaf9185ed77 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:43.176084 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-5216ec28-bd83-4d01-8c79-fbaf9185ed77 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.152151 Jun 22 09:15:43.176639 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 518/986] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:43 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:43.843053 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-780083cf-4879-4d92-bae0-f6fa682a2d52 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:43.844003 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-780083cf-4879-4d92-bae0-f6fa682a2d52 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:43.851362 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-780083cf-4879-4d92-bae0-f6fa682a2d52 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:43.851804 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-780083cf-4879-4d92-bae0-f6fa682a2d52 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:43.852552 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-780083cf-4879-4d92-bae0-f6fa682a2d52 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:43.853006 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-780083cf-4879-4d92-bae0-f6fa682a2d52 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:43.881549 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-780083cf-4879-4d92-bae0-f6fa682a2d52 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042418 Jun 22 09:15:43.882032 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 469/987] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:43 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:44.193288 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e1f33712-f7f0-4c3d-84b8-4a2984e3a9c5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:44.193836 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e1f33712-f7f0-4c3d-84b8-4a2984e3a9c5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:44.200391 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e1f33712-f7f0-4c3d-84b8-4a2984e3a9c5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:44.200887 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e1f33712-f7f0-4c3d-84b8-4a2984e3a9c5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:44.201659 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e1f33712-f7f0-4c3d-84b8-4a2984e3a9c5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:44.202098 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e1f33712-f7f0-4c3d-84b8-4a2984e3a9c5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:44.330040 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-e1f33712-f7f0-4c3d-84b8-4a2984e3a9c5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:44.338030 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e1f33712-f7f0-4c3d-84b8-4a2984e3a9c5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.148815 Jun 22 09:15:44.338638 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 519/988] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:44 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:44.892935 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-9a6cce54-d942-41bf-b97f-5f2ba49421cc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:44.893864 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-9a6cce54-d942-41bf-b97f-5f2ba49421cc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:44.896119 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=60 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:44.900894 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9a6cce54-d942-41bf-b97f-5f2ba49421cc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:44.901592 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9a6cce54-d942-41bf-b97f-5f2ba49421cc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:44.902367 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9a6cce54-d942-41bf-b97f-5f2ba49421cc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:44.902799 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9a6cce54-d942-41bf-b97f-5f2ba49421cc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:44.932011 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-9a6cce54-d942-41bf-b97f-5f2ba49421cc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043010 Jun 22 09:15:44.932653 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 470/989] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:44 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:45.355560 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-b48ad350-37ba-437a-90dc-f62eda6b8431 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:45.356311 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-b48ad350-37ba-437a-90dc-f62eda6b8431 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:45.365191 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b48ad350-37ba-437a-90dc-f62eda6b8431 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:45.365647 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b48ad350-37ba-437a-90dc-f62eda6b8431 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:45.366420 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b48ad350-37ba-437a-90dc-f62eda6b8431 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:45.366865 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b48ad350-37ba-437a-90dc-f62eda6b8431 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:45.496071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-b48ad350-37ba-437a-90dc-f62eda6b8431 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:45.503985 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-b48ad350-37ba-437a-90dc-f62eda6b8431 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.152410 Jun 22 09:15:45.504568 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 520/990] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:45 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:45.944422 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c4835815-63ad-4c86-aa01-a7e3eff4af49 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:45.945376 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c4835815-63ad-4c86-aa01-a7e3eff4af49 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:45.951817 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c4835815-63ad-4c86-aa01-a7e3eff4af49 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:45.955282 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c4835815-63ad-4c86-aa01-a7e3eff4af49 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:45.955282 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c4835815-63ad-4c86-aa01-a7e3eff4af49 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:45.955282 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c4835815-63ad-4c86-aa01-a7e3eff4af49 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:45.982039 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c4835815-63ad-4c86-aa01-a7e3eff4af49 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041967 Jun 22 09:15:45.982586 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 471/991] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:45 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:46.520957 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-70a0812d-1fed-43dc-83ee-0f8165eb5374 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:46.521621 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-70a0812d-1fed-43dc-83ee-0f8165eb5374 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:46.528402 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-70a0812d-1fed-43dc-83ee-0f8165eb5374 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:46.528878 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-70a0812d-1fed-43dc-83ee-0f8165eb5374 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:46.529672 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-70a0812d-1fed-43dc-83ee-0f8165eb5374 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:46.530109 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-70a0812d-1fed-43dc-83ee-0f8165eb5374 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:46.658203 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-70a0812d-1fed-43dc-83ee-0f8165eb5374 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:46.666122 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-70a0812d-1fed-43dc-83ee-0f8165eb5374 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149098 Jun 22 09:15:46.666684 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 521/992] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:46 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:46.993133 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-306bec7a-25e4-46a2-ba02-b6a59d62d53a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:46.994116 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-306bec7a-25e4-46a2-ba02-b6a59d62d53a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:47.001681 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-306bec7a-25e4-46a2-ba02-b6a59d62d53a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:47.002154 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-306bec7a-25e4-46a2-ba02-b6a59d62d53a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:47.002926 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-306bec7a-25e4-46a2-ba02-b6a59d62d53a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:47.003370 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-306bec7a-25e4-46a2-ba02-b6a59d62d53a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:47.033994 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-306bec7a-25e4-46a2-ba02-b6a59d62d53a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044942 Jun 22 09:15:47.034565 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 472/993] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:46 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:47.683411 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c4f0d5cc-e730-4377-b068-cbcebe56e070 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:47.683957 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c4f0d5cc-e730-4377-b068-cbcebe56e070 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:47.690613 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c4f0d5cc-e730-4377-b068-cbcebe56e070 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:47.691064 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c4f0d5cc-e730-4377-b068-cbcebe56e070 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:47.691829 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c4f0d5cc-e730-4377-b068-cbcebe56e070 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:47.692274 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c4f0d5cc-e730-4377-b068-cbcebe56e070 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:47.696179 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=100 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:47.820196 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c4f0d5cc-e730-4377-b068-cbcebe56e070 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:47.828187 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c4f0d5cc-e730-4377-b068-cbcebe56e070 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.148691 Jun 22 09:15:47.829281 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 522/994] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:47 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:48.045475 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-d42fcfb8-b9eb-4d9b-b5f5-416bcb283d29 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:48.046400 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-d42fcfb8-b9eb-4d9b-b5f5-416bcb283d29 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:48.052946 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d42fcfb8-b9eb-4d9b-b5f5-416bcb283d29 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:48.053399 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d42fcfb8-b9eb-4d9b-b5f5-416bcb283d29 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:48.054196 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d42fcfb8-b9eb-4d9b-b5f5-416bcb283d29 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:48.054632 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d42fcfb8-b9eb-4d9b-b5f5-416bcb283d29 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:48.084421 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-d42fcfb8-b9eb-4d9b-b5f5-416bcb283d29 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042870 Jun 22 09:15:48.085124 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 473/995] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:48 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:48.846147 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c6a290b0-d98b-4e50-8b8b-54a455bf8c84 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:48.846763 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c6a290b0-d98b-4e50-8b8b-54a455bf8c84 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:48.853585 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c6a290b0-d98b-4e50-8b8b-54a455bf8c84 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:48.854028 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c6a290b0-d98b-4e50-8b8b-54a455bf8c84 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:48.854818 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c6a290b0-d98b-4e50-8b8b-54a455bf8c84 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:48.855255 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c6a290b0-d98b-4e50-8b8b-54a455bf8c84 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:48.990367 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c6a290b0-d98b-4e50-8b8b-54a455bf8c84 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:48.998445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c6a290b0-d98b-4e50-8b8b-54a455bf8c84 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.156662 Jun 22 09:15:48.999036 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 523/996] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:48 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:49.096978 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-621ff57f-732f-4ab7-b154-55a02e64ad93 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:49.097869 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-621ff57f-732f-4ab7-b154-55a02e64ad93 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:49.104354 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-621ff57f-732f-4ab7-b154-55a02e64ad93 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:49.104833 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-621ff57f-732f-4ab7-b154-55a02e64ad93 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:49.105598 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-621ff57f-732f-4ab7-b154-55a02e64ad93 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:49.106040 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-621ff57f-732f-4ab7-b154-55a02e64ad93 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:49.134795 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-621ff57f-732f-4ab7-b154-55a02e64ad93 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042623 Jun 22 09:15:49.135343 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 474/997] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:49 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:50.015523 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-6eee2a26-8ee5-4a0c-8713-51c8ef2c8183 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:50.016225 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-6eee2a26-8ee5-4a0c-8713-51c8ef2c8183 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:50.023017 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6eee2a26-8ee5-4a0c-8713-51c8ef2c8183 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:50.023971 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6eee2a26-8ee5-4a0c-8713-51c8ef2c8183 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:50.024214 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6eee2a26-8ee5-4a0c-8713-51c8ef2c8183 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:50.024661 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6eee2a26-8ee5-4a0c-8713-51c8ef2c8183 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:50.146149 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c295cf8f-413c-4db9-a474-dd8a55e64f7c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:50.147150 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c295cf8f-413c-4db9-a474-dd8a55e64f7c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:50.153522 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c295cf8f-413c-4db9-a474-dd8a55e64f7c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:50.153968 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c295cf8f-413c-4db9-a474-dd8a55e64f7c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:50.154783 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c295cf8f-413c-4db9-a474-dd8a55e64f7c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:50.155195 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c295cf8f-413c-4db9-a474-dd8a55e64f7c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:50.160633 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-6eee2a26-8ee5-4a0c-8713-51c8ef2c8183 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:50.168535 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-6eee2a26-8ee5-4a0c-8713-51c8ef2c8183 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.156987 Jun 22 09:15:50.169132 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 524/998] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:50 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:50.184593 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c295cf8f-413c-4db9-a474-dd8a55e64f7c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042914 Jun 22 09:15:50.185167 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 475/999] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:50 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:15:51.186189 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-db73d2f1-d968-4fe9-b805-e01a4a9bab5d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:51.186846 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-db73d2f1-d968-4fe9-b805-e01a4a9bab5d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:51.194273 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-db73d2f1-d968-4fe9-b805-e01a4a9bab5d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:51.194724 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-db73d2f1-d968-4fe9-b805-e01a4a9bab5d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:51.195502 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-db73d2f1-d968-4fe9-b805-e01a4a9bab5d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:51.195945 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-db73d2f1-d968-4fe9-b805-e01a4a9bab5d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:51.199558 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f100a45a-1f43-47d4-90c5-d17b3cb713a4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:51.201197 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f100a45a-1f43-47d4-90c5-d17b3cb713a4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:51.209849 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f100a45a-1f43-47d4-90c5-d17b3cb713a4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:51.210454 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f100a45a-1f43-47d4-90c5-d17b3cb713a4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:51.211644 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f100a45a-1f43-47d4-90c5-d17b3cb713a4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:51.212306 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f100a45a-1f43-47d4-90c5-d17b3cb713a4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:51.246265 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f100a45a-1f43-47d4-90c5-d17b3cb713a4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052680 Jun 22 09:15:51.246839 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 476/1000] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:51 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:51.330768 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-db73d2f1-d968-4fe9-b805-e01a4a9bab5d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:51.338725 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-db73d2f1-d968-4fe9-b805-e01a4a9bab5d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.156699 Jun 22 09:15:51.339285 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 525/1001] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:51 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:15:52.257596 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6703b3f4-3fa1-431d-a346-78f16e5cddf2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:52.258452 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-6703b3f4-3fa1-431d-a346-78f16e5cddf2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:52.265238 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6703b3f4-3fa1-431d-a346-78f16e5cddf2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:52.265804 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6703b3f4-3fa1-431d-a346-78f16e5cddf2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:52.266714 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6703b3f4-3fa1-431d-a346-78f16e5cddf2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:52.267185 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6703b3f4-3fa1-431d-a346-78f16e5cddf2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:52.295747 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-6703b3f4-3fa1-431d-a346-78f16e5cddf2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042104 Jun 22 09:15:52.296296 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 477/1002] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:52 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:52.356099 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-69285388-710e-434c-b0ed-b0f1e4747041 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:52.356737 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-69285388-710e-434c-b0ed-b0f1e4747041 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:52.363746 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-69285388-710e-434c-b0ed-b0f1e4747041 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:52.364191 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-69285388-710e-434c-b0ed-b0f1e4747041 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:52.364963 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-69285388-710e-434c-b0ed-b0f1e4747041 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:52.365397 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-69285388-710e-434c-b0ed-b0f1e4747041 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:52.490675 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-69285388-710e-434c-b0ed-b0f1e4747041 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:52.498553 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-69285388-710e-434c-b0ed-b0f1e4747041 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.146252 Jun 22 09:15:52.499108 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 526/1003] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:52 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:53.307912 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-87511fcf-388b-41d4-b59e-b8e506299b45 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:53.308796 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-87511fcf-388b-41d4-b59e-b8e506299b45 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:53.316223 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-87511fcf-388b-41d4-b59e-b8e506299b45 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:53.316674 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-87511fcf-388b-41d4-b59e-b8e506299b45 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:53.317456 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-87511fcf-388b-41d4-b59e-b8e506299b45 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:53.317892 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-87511fcf-388b-41d4-b59e-b8e506299b45 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:53.354625 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-87511fcf-388b-41d4-b59e-b8e506299b45 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050702 Jun 22 09:15:53.357740 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 478/1004] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:53 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:53.515369 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-14db87ca-d05f-4c8e-b7d4-de3f3d884a42 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:53.516663 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-14db87ca-d05f-4c8e-b7d4-de3f3d884a42 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:53.523492 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-14db87ca-d05f-4c8e-b7d4-de3f3d884a42 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:53.523942 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-14db87ca-d05f-4c8e-b7d4-de3f3d884a42 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:53.524692 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-14db87ca-d05f-4c8e-b7d4-de3f3d884a42 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:53.525153 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-14db87ca-d05f-4c8e-b7d4-de3f3d884a42 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:53.653421 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-14db87ca-d05f-4c8e-b7d4-de3f3d884a42 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:53.661421 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-14db87ca-d05f-4c8e-b7d4-de3f3d884a42 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149892 Jun 22 09:15:53.661980 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 527/1005] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:53 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:54.371024 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-9325cc75-8582-43cb-9c05-59644d72b34c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:54.371909 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-9325cc75-8582-43cb-9c05-59644d72b34c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:54.378772 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9325cc75-8582-43cb-9c05-59644d72b34c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:54.379221 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9325cc75-8582-43cb-9c05-59644d72b34c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:54.379980 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9325cc75-8582-43cb-9c05-59644d72b34c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:54.380415 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9325cc75-8582-43cb-9c05-59644d72b34c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:54.409732 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-9325cc75-8582-43cb-9c05-59644d72b34c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042746 Jun 22 09:15:54.410279 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 479/1006] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:54 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:54.677677 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-88debd37-0a1d-4110-b606-d977e6ec00f2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:54.678213 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-88debd37-0a1d-4110-b606-d977e6ec00f2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:54.684617 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-88debd37-0a1d-4110-b606-d977e6ec00f2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:54.685167 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-88debd37-0a1d-4110-b606-d977e6ec00f2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:54.685922 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-88debd37-0a1d-4110-b606-d977e6ec00f2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:54.686352 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-88debd37-0a1d-4110-b606-d977e6ec00f2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:54.813594 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-88debd37-0a1d-4110-b606-d977e6ec00f2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:54.821477 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-88debd37-0a1d-4110-b606-d977e6ec00f2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.147713 Jun 22 09:15:54.822042 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 528/1007] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:54 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:55.421312 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1e3f1340-0dc8-4dc9-a5dd-821349146d2c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:55.422784 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1e3f1340-0dc8-4dc9-a5dd-821349146d2c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:55.429284 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1e3f1340-0dc8-4dc9-a5dd-821349146d2c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:55.429738 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1e3f1340-0dc8-4dc9-a5dd-821349146d2c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:55.430506 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1e3f1340-0dc8-4dc9-a5dd-821349146d2c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:55.430944 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1e3f1340-0dc8-4dc9-a5dd-821349146d2c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:55.460381 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1e3f1340-0dc8-4dc9-a5dd-821349146d2c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043189 Jun 22 09:15:55.460970 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 480/1008] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:55 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:55.839139 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-92827232-097e-4c8b-988f-ede3bf4ec8f5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:55.839751 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-92827232-097e-4c8b-988f-ede3bf4ec8f5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:55.846878 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-92827232-097e-4c8b-988f-ede3bf4ec8f5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:55.852206 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-92827232-097e-4c8b-988f-ede3bf4ec8f5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:55.852206 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-92827232-097e-4c8b-988f-ede3bf4ec8f5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:55.852206 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-92827232-097e-4c8b-988f-ede3bf4ec8f5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:55.979170 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-92827232-097e-4c8b-988f-ede3bf4ec8f5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:55.987521 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-92827232-097e-4c8b-988f-ede3bf4ec8f5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.152454 Jun 22 09:15:55.988077 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 529/1009] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:55 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:56.472361 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-01de6663-b781-4bde-b830-1f9649efff56 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:56.473260 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-01de6663-b781-4bde-b830-1f9649efff56 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:56.479761 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-01de6663-b781-4bde-b830-1f9649efff56 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:56.480215 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-01de6663-b781-4bde-b830-1f9649efff56 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:56.481010 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-01de6663-b781-4bde-b830-1f9649efff56 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:56.481454 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-01de6663-b781-4bde-b830-1f9649efff56 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:56.510923 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-01de6663-b781-4bde-b830-1f9649efff56 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043003 Jun 22 09:15:56.511475 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 481/1010] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:56 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:57.005208 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-60899005-2caa-49a3-b927-d5072e80f259 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:57.005818 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-60899005-2caa-49a3-b927-d5072e80f259 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:57.012258 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-60899005-2caa-49a3-b927-d5072e80f259 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:57.012706 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-60899005-2caa-49a3-b927-d5072e80f259 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:57.013492 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-60899005-2caa-49a3-b927-d5072e80f259 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:57.013925 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-60899005-2caa-49a3-b927-d5072e80f259 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:57.143491 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-60899005-2caa-49a3-b927-d5072e80f259 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:57.151617 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-60899005-2caa-49a3-b927-d5072e80f259 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.150366 Jun 22 09:15:57.152183 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 530/1011] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:56 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:57.523262 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-0f1bea2e-6fce-4c1e-b063-374cff937f27 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:57.524097 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-0f1bea2e-6fce-4c1e-b063-374cff937f27 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:57.530861 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0f1bea2e-6fce-4c1e-b063-374cff937f27 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:57.532300 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0f1bea2e-6fce-4c1e-b063-374cff937f27 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:57.532960 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0f1bea2e-6fce-4c1e-b063-374cff937f27 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:57.533395 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0f1bea2e-6fce-4c1e-b063-374cff937f27 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:57.561264 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-0f1bea2e-6fce-4c1e-b063-374cff937f27 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042021 Jun 22 09:15:57.561801 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 482/1012] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:57 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:58.169354 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f552446d-7172-44cc-8a2f-3cc3d03257fb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:58.170029 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-f552446d-7172-44cc-8a2f-3cc3d03257fb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:58.176636 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f552446d-7172-44cc-8a2f-3cc3d03257fb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:58.177109 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f552446d-7172-44cc-8a2f-3cc3d03257fb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:58.177862 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f552446d-7172-44cc-8a2f-3cc3d03257fb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:58.178292 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f552446d-7172-44cc-8a2f-3cc3d03257fb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:58.307024 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-f552446d-7172-44cc-8a2f-3cc3d03257fb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:58.315145 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f552446d-7172-44cc-8a2f-3cc3d03257fb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149682 Jun 22 09:15:58.315712 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 531/1013] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:58 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:15:58.572565 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-0d1173d7-d704-4099-8823-4fd31064dbd8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:58.573531 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-0d1173d7-d704-4099-8823-4fd31064dbd8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:58.580529 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0d1173d7-d704-4099-8823-4fd31064dbd8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:58.581009 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0d1173d7-d704-4099-8823-4fd31064dbd8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:58.581778 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0d1173d7-d704-4099-8823-4fd31064dbd8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:58.582243 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0d1173d7-d704-4099-8823-4fd31064dbd8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:58.610388 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-0d1173d7-d704-4099-8823-4fd31064dbd8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041721 Jun 22 09:15:58.610935 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 483/1014] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:58 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:59.332217 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-96bb56dd-bdcc-46f6-a180-c02a60e60ca7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:59.332858 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-96bb56dd-bdcc-46f6-a180-c02a60e60ca7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:59.341514 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-96bb56dd-bdcc-46f6-a180-c02a60e60ca7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:59.341969 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-96bb56dd-bdcc-46f6-a180-c02a60e60ca7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:59.342772 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-96bb56dd-bdcc-46f6-a180-c02a60e60ca7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:59.343211 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-96bb56dd-bdcc-46f6-a180-c02a60e60ca7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:59.479105 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-96bb56dd-bdcc-46f6-a180-c02a60e60ca7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:59.487734 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-96bb56dd-bdcc-46f6-a180-c02a60e60ca7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.159651 Jun 22 09:15:59.488281 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 532/1015] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:59 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:59.621958 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-4ca147c7-3fe5-4b8e-855e-a068718805be tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:59.622810 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-4ca147c7-3fe5-4b8e-855e-a068718805be tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:59.629327 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4ca147c7-3fe5-4b8e-855e-a068718805be tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:59.629779 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4ca147c7-3fe5-4b8e-855e-a068718805be tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:59.630546 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4ca147c7-3fe5-4b8e-855e-a068718805be tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:59.630988 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4ca147c7-3fe5-4b8e-855e-a068718805be tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:59.660479 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-4ca147c7-3fe5-4b8e-855e-a068718805be tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042586 Jun 22 09:15:59.661074 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 484/1016] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:15:59 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:00.505893 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-cf25a5ba-ee41-4c73-a2ca-cc6c5cad617d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:00.506509 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-cf25a5ba-ee41-4c73-a2ca-cc6c5cad617d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:00.513018 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cf25a5ba-ee41-4c73-a2ca-cc6c5cad617d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:00.513466 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cf25a5ba-ee41-4c73-a2ca-cc6c5cad617d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:00.514227 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cf25a5ba-ee41-4c73-a2ca-cc6c5cad617d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:00.514661 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cf25a5ba-ee41-4c73-a2ca-cc6c5cad617d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:00.642980 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-cf25a5ba-ee41-4c73-a2ca-cc6c5cad617d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:00.651148 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-cf25a5ba-ee41-4c73-a2ca-cc6c5cad617d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.150127 Jun 22 09:16:00.651707 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 533/1017] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:00 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:00.671822 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a7289ea4-cf81-41e9-9ea8-d9061a8ec0c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:00.672839 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a7289ea4-cf81-41e9-9ea8-d9061a8ec0c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:00.683287 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a7289ea4-cf81-41e9-9ea8-d9061a8ec0c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:00.684327 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a7289ea4-cf81-41e9-9ea8-d9061a8ec0c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:00.684511 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a7289ea4-cf81-41e9-9ea8-d9061a8ec0c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:00.684987 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a7289ea4-cf81-41e9-9ea8-d9061a8ec0c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:00.690737 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=100 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:00.716827 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a7289ea4-cf81-41e9-9ea8-d9061a8ec0c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048876 Jun 22 09:16:00.717315 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 485/1018] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:00 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:01.667909 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-5fc8f0a6-7c40-4483-bde4-52de4514c736 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:01.668516 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-5fc8f0a6-7c40-4483-bde4-52de4514c736 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:01.675080 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5fc8f0a6-7c40-4483-bde4-52de4514c736 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:01.675526 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5fc8f0a6-7c40-4483-bde4-52de4514c736 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:01.676276 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5fc8f0a6-7c40-4483-bde4-52de4514c736 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:01.676703 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5fc8f0a6-7c40-4483-bde4-52de4514c736 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:01.729446 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-8d42f117-7482-4252-a70e-76cbaba0d951 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:01.730293 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-8d42f117-7482-4252-a70e-76cbaba0d951 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:01.737583 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8d42f117-7482-4252-a70e-76cbaba0d951 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:01.738039 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8d42f117-7482-4252-a70e-76cbaba0d951 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:01.738819 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8d42f117-7482-4252-a70e-76cbaba0d951 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:01.739269 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8d42f117-7482-4252-a70e-76cbaba0d951 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:01.770047 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-8d42f117-7482-4252-a70e-76cbaba0d951 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044967 Jun 22 09:16:01.770631 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 486/1019] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:01 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:16:01.808065 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-5fc8f0a6-7c40-4483-bde4-52de4514c736 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:01.816466 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-5fc8f0a6-7c40-4483-bde4-52de4514c736 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.152355 Jun 22 09:16:01.817060 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 534/1020] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:01 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:02.781868 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-7fdc956d-94b3-4459-a543-4cadc502d64b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:02.783297 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-7fdc956d-94b3-4459-a543-4cadc502d64b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:02.789848 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7fdc956d-94b3-4459-a543-4cadc502d64b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:02.790300 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7fdc956d-94b3-4459-a543-4cadc502d64b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:02.791060 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7fdc956d-94b3-4459-a543-4cadc502d64b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:02.791506 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7fdc956d-94b3-4459-a543-4cadc502d64b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:02.821082 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-7fdc956d-94b3-4459-a543-4cadc502d64b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043231 Jun 22 09:16:02.821635 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 487/1021] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:02 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:02.833287 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d0fdd70d-8f60-45df-8a1d-74ee39b867a7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:02.833906 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-d0fdd70d-8f60-45df-8a1d-74ee39b867a7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:02.840292 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d0fdd70d-8f60-45df-8a1d-74ee39b867a7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:02.840743 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d0fdd70d-8f60-45df-8a1d-74ee39b867a7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:02.841531 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d0fdd70d-8f60-45df-8a1d-74ee39b867a7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:02.841975 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d0fdd70d-8f60-45df-8a1d-74ee39b867a7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:02.970774 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-d0fdd70d-8f60-45df-8a1d-74ee39b867a7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:02.978926 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d0fdd70d-8f60-45df-8a1d-74ee39b867a7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149395 Jun 22 09:16:02.979485 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 535/1022] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:02 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:03.832167 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-96cd9f38-c130-46de-9921-cc7719ad2cf2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:03.833115 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-96cd9f38-c130-46de-9921-cc7719ad2cf2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:03.839560 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-96cd9f38-c130-46de-9921-cc7719ad2cf2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:03.840016 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-96cd9f38-c130-46de-9921-cc7719ad2cf2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:03.840841 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-96cd9f38-c130-46de-9921-cc7719ad2cf2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:03.841286 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-96cd9f38-c130-46de-9921-cc7719ad2cf2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:03.869404 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-96cd9f38-c130-46de-9921-cc7719ad2cf2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041883 Jun 22 09:16:03.869950 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 488/1023] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:03 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:03.996338 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-83e56e2d-02bc-439b-8b06-a03658bc1527 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:03.997011 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-83e56e2d-02bc-439b-8b06-a03658bc1527 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:04.004174 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-83e56e2d-02bc-439b-8b06-a03658bc1527 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:04.004623 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-83e56e2d-02bc-439b-8b06-a03658bc1527 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:04.005414 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-83e56e2d-02bc-439b-8b06-a03658bc1527 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:04.005849 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-83e56e2d-02bc-439b-8b06-a03658bc1527 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:04.132006 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-83e56e2d-02bc-439b-8b06-a03658bc1527 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:04.139889 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-83e56e2d-02bc-439b-8b06-a03658bc1527 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.147490 Jun 22 09:16:04.140446 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 536/1024] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:03 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:04.881123 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-fe09e0f1-7d46-4382-bc2e-7f772bc97ae3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:04.881984 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-fe09e0f1-7d46-4382-bc2e-7f772bc97ae3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:04.888413 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fe09e0f1-7d46-4382-bc2e-7f772bc97ae3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:04.888898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fe09e0f1-7d46-4382-bc2e-7f772bc97ae3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:04.889664 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fe09e0f1-7d46-4382-bc2e-7f772bc97ae3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:04.890104 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fe09e0f1-7d46-4382-bc2e-7f772bc97ae3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:04.919574 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-fe09e0f1-7d46-4382-bc2e-7f772bc97ae3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042537 Jun 22 09:16:04.920119 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 489/1025] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:04 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:05.157339 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-efbc4e6a-b78f-4b38-b286-f15adea9934a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:05.158845 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-efbc4e6a-b78f-4b38-b286-f15adea9934a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:05.165236 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-efbc4e6a-b78f-4b38-b286-f15adea9934a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:05.165681 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-efbc4e6a-b78f-4b38-b286-f15adea9934a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:05.166435 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-efbc4e6a-b78f-4b38-b286-f15adea9934a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:05.166868 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-efbc4e6a-b78f-4b38-b286-f15adea9934a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:05.296034 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-efbc4e6a-b78f-4b38-b286-f15adea9934a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:05.303859 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-efbc4e6a-b78f-4b38-b286-f15adea9934a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.150836 Jun 22 09:16:05.304416 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 537/1026] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:05 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:05.931223 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-7b3c0fdc-e72a-4b85-aa58-b0c6c3ad442d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:05.932066 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-7b3c0fdc-e72a-4b85-aa58-b0c6c3ad442d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:05.938508 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7b3c0fdc-e72a-4b85-aa58-b0c6c3ad442d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:05.939637 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7b3c0fdc-e72a-4b85-aa58-b0c6c3ad442d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:05.940397 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7b3c0fdc-e72a-4b85-aa58-b0c6c3ad442d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:05.940863 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7b3c0fdc-e72a-4b85-aa58-b0c6c3ad442d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:05.968674 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-7b3c0fdc-e72a-4b85-aa58-b0c6c3ad442d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041573 Jun 22 09:16:05.969254 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 490/1027] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:05 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:06.320644 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-db557500-884c-4a88-a915-b9e3590906f2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:06.321278 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-db557500-884c-4a88-a915-b9e3590906f2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:06.327719 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-db557500-884c-4a88-a915-b9e3590906f2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:06.328164 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-db557500-884c-4a88-a915-b9e3590906f2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:06.328943 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-db557500-884c-4a88-a915-b9e3590906f2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:06.329907 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-db557500-884c-4a88-a915-b9e3590906f2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:06.464329 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-db557500-884c-4a88-a915-b9e3590906f2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:06.466647 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=100 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:06.474108 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-db557500-884c-4a88-a915-b9e3590906f2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.157259 Jun 22 09:16:06.474674 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 538/1028] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:06 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:06.980820 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6be09c7a-b735-434b-b160-658d04501ec2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:06.981700 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-6be09c7a-b735-434b-b160-658d04501ec2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:06.988352 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6be09c7a-b735-434b-b160-658d04501ec2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:06.988826 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6be09c7a-b735-434b-b160-658d04501ec2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:06.989606 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6be09c7a-b735-434b-b160-658d04501ec2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:06.990053 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6be09c7a-b735-434b-b160-658d04501ec2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:07.020931 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-6be09c7a-b735-434b-b160-658d04501ec2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044105 Jun 22 09:16:07.021494 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 491/1029] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:06 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:07.491710 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9b46402e-f665-4dd9-ae27-c38ba4c780bb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:07.492326 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9b46402e-f665-4dd9-ae27-c38ba4c780bb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:07.499415 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9b46402e-f665-4dd9-ae27-c38ba4c780bb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:07.499870 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9b46402e-f665-4dd9-ae27-c38ba4c780bb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:07.500636 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9b46402e-f665-4dd9-ae27-c38ba4c780bb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:07.501137 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9b46402e-f665-4dd9-ae27-c38ba4c780bb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:07.630663 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9b46402e-f665-4dd9-ae27-c38ba4c780bb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:07.638570 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9b46402e-f665-4dd9-ae27-c38ba4c780bb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.150703 Jun 22 09:16:07.639134 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 539/1030] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:07 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:08.035063 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-bbea0134-0c25-467f-b200-bf2ec192b55b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:08.035990 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-bbea0134-0c25-467f-b200-bf2ec192b55b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:08.042449 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bbea0134-0c25-467f-b200-bf2ec192b55b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:08.042903 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bbea0134-0c25-467f-b200-bf2ec192b55b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:08.043659 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bbea0134-0c25-467f-b200-bf2ec192b55b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:08.044098 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bbea0134-0c25-467f-b200-bf2ec192b55b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:08.072821 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-bbea0134-0c25-467f-b200-bf2ec192b55b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042425 Jun 22 09:16:08.073379 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 492/1031] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:08 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:08.655884 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e786208a-3d88-40c0-a55b-35396e2de72a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:08.656498 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e786208a-3d88-40c0-a55b-35396e2de72a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:08.663194 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e786208a-3d88-40c0-a55b-35396e2de72a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:08.663635 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e786208a-3d88-40c0-a55b-35396e2de72a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:08.664397 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e786208a-3d88-40c0-a55b-35396e2de72a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:08.664897 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e786208a-3d88-40c0-a55b-35396e2de72a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:08.791966 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-e786208a-3d88-40c0-a55b-35396e2de72a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:08.800610 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e786208a-3d88-40c0-a55b-35396e2de72a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.148573 Jun 22 09:16:08.801217 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 540/1032] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:08 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:09.084805 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-602d8691-c37e-4f00-806b-2bc8a35a308d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:09.085736 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-602d8691-c37e-4f00-806b-2bc8a35a308d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:09.092155 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-602d8691-c37e-4f00-806b-2bc8a35a308d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:09.092637 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-602d8691-c37e-4f00-806b-2bc8a35a308d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:09.093436 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-602d8691-c37e-4f00-806b-2bc8a35a308d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:09.093873 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-602d8691-c37e-4f00-806b-2bc8a35a308d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:09.121994 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-602d8691-c37e-4f00-806b-2bc8a35a308d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041157 Jun 22 09:16:09.122545 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 493/1033] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:09 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:09.817035 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-362b28c7-98bd-48b2-bb5a-922a458ac3c6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:09.817647 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-362b28c7-98bd-48b2-bb5a-922a458ac3c6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:09.825917 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-362b28c7-98bd-48b2-bb5a-922a458ac3c6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:09.826370 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-362b28c7-98bd-48b2-bb5a-922a458ac3c6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:09.827126 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-362b28c7-98bd-48b2-bb5a-922a458ac3c6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:09.827560 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-362b28c7-98bd-48b2-bb5a-922a458ac3c6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:09.962124 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-362b28c7-98bd-48b2-bb5a-922a458ac3c6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:09.970783 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-362b28c7-98bd-48b2-bb5a-922a458ac3c6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.157910 Jun 22 09:16:09.971343 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 541/1034] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:09 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:10.133576 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ded0a4de-94db-4ec5-9f30-6ab62a3d0801 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:10.134424 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ded0a4de-94db-4ec5-9f30-6ab62a3d0801 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:10.141026 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ded0a4de-94db-4ec5-9f30-6ab62a3d0801 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:10.142005 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ded0a4de-94db-4ec5-9f30-6ab62a3d0801 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:10.142765 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ded0a4de-94db-4ec5-9f30-6ab62a3d0801 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:10.143205 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ded0a4de-94db-4ec5-9f30-6ab62a3d0801 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:10.172119 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ded0a4de-94db-4ec5-9f30-6ab62a3d0801 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042565 Jun 22 09:16:10.172772 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 494/1035] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:10 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:10.988100 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-0079fe27-609f-4174-9a52-ed579ec36396 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:10.988705 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-0079fe27-609f-4174-9a52-ed579ec36396 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:10.991015 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=52 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:10.995794 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0079fe27-609f-4174-9a52-ed579ec36396 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:10.996236 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0079fe27-609f-4174-9a52-ed579ec36396 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:10.997023 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0079fe27-609f-4174-9a52-ed579ec36396 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:10.997456 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0079fe27-609f-4174-9a52-ed579ec36396 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:11.137048 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-0079fe27-609f-4174-9a52-ed579ec36396 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:11.145005 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-0079fe27-609f-4174-9a52-ed579ec36396 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.161480 Jun 22 09:16:11.145567 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 542/1036] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:10 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:11.183656 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1253a7a7-be56-4ba2-a0c2-cecd8d0c1299 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:11.184614 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1253a7a7-be56-4ba2-a0c2-cecd8d0c1299 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:11.191831 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1253a7a7-be56-4ba2-a0c2-cecd8d0c1299 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:11.192283 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1253a7a7-be56-4ba2-a0c2-cecd8d0c1299 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:11.193078 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1253a7a7-be56-4ba2-a0c2-cecd8d0c1299 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:11.193521 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1253a7a7-be56-4ba2-a0c2-cecd8d0c1299 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:11.223315 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1253a7a7-be56-4ba2-a0c2-cecd8d0c1299 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043621 Jun 22 09:16:11.223869 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 495/1037] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:11 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:12.161203 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-07d90af1-7fe7-41cc-917e-16ff6ee45a98 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:12.161821 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-07d90af1-7fe7-41cc-917e-16ff6ee45a98 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:12.168373 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-07d90af1-7fe7-41cc-917e-16ff6ee45a98 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:12.168855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-07d90af1-7fe7-41cc-917e-16ff6ee45a98 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:12.169614 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-07d90af1-7fe7-41cc-917e-16ff6ee45a98 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:12.170052 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-07d90af1-7fe7-41cc-917e-16ff6ee45a98 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:12.235167 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-33a4b511-dda1-4b27-9264-0b7c8e32c6e9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:12.236742 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-33a4b511-dda1-4b27-9264-0b7c8e32c6e9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:12.243281 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-33a4b511-dda1-4b27-9264-0b7c8e32c6e9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:12.243731 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-33a4b511-dda1-4b27-9264-0b7c8e32c6e9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:12.244500 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-33a4b511-dda1-4b27-9264-0b7c8e32c6e9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:12.244970 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-33a4b511-dda1-4b27-9264-0b7c8e32c6e9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:12.275121 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-33a4b511-dda1-4b27-9264-0b7c8e32c6e9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043729 Jun 22 09:16:12.275694 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 496/1038] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:12 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:16:12.298509 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-07d90af1-7fe7-41cc-917e-16ff6ee45a98 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:12.306555 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-07d90af1-7fe7-41cc-917e-16ff6ee45a98 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149166 Jun 22 09:16:12.307121 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 543/1039] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:12 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:13.287358 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-30ad74b7-715d-4582-9f1f-7b75044be4d7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:13.288286 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-30ad74b7-715d-4582-9f1f-7b75044be4d7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:13.295020 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-30ad74b7-715d-4582-9f1f-7b75044be4d7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:13.295474 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-30ad74b7-715d-4582-9f1f-7b75044be4d7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:13.296253 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-30ad74b7-715d-4582-9f1f-7b75044be4d7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:13.296691 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-30ad74b7-715d-4582-9f1f-7b75044be4d7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:13.324067 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-cf35c3a5-229e-4b43-a79d-f2376d66f8ba tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:13.324693 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-cf35c3a5-229e-4b43-a79d-f2376d66f8ba tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:13.327851 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-30ad74b7-715d-4582-9f1f-7b75044be4d7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045063 Jun 22 09:16:13.328637 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 497/1040] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:13 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:13.332681 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cf35c3a5-229e-4b43-a79d-f2376d66f8ba tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:13.333233 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cf35c3a5-229e-4b43-a79d-f2376d66f8ba tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:13.334103 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cf35c3a5-229e-4b43-a79d-f2376d66f8ba tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:13.334613 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cf35c3a5-229e-4b43-a79d-f2376d66f8ba tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:13.473374 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-cf35c3a5-229e-4b43-a79d-f2376d66f8ba tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:13.481804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-cf35c3a5-229e-4b43-a79d-f2376d66f8ba tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.161679 Jun 22 09:16:13.482410 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 544/1041] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:13 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:16:14.339922 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-979753fb-cb0b-4af3-9028-7ad7137a5846 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:14.345882 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-979753fb-cb0b-4af3-9028-7ad7137a5846 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:14.347301 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:16:14.347507 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Wed Jun 22 09:16:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments (ip 10.222.0.16) !!! Jun 22 09:16:14.349390 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-979753fb-cb0b-4af3-9028-7ad7137a5846 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:14.350142 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-979753fb-cb0b-4af3-9028-7ad7137a5846 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:14.350928 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-979753fb-cb0b-4af3-9028-7ad7137a5846 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:14.351896 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-979753fb-cb0b-4af3-9028-7ad7137a5846 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:14.382169 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-979753fb-cb0b-4af3-9028-7ad7137a5846 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046182 Jun 22 09:16:14.383097 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 498/1042] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:14 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:14.499148 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9fe90829-3320-42c3-8109-068ecffa3457 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:14.499766 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9fe90829-3320-42c3-8109-068ecffa3457 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:14.506622 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9fe90829-3320-42c3-8109-068ecffa3457 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:14.507073 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9fe90829-3320-42c3-8109-068ecffa3457 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:14.507837 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9fe90829-3320-42c3-8109-068ecffa3457 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:14.508284 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9fe90829-3320-42c3-8109-068ecffa3457 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:14.634751 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9fe90829-3320-42c3-8109-068ecffa3457 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:14.643353 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9fe90829-3320-42c3-8109-068ecffa3457 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.148082 Jun 22 09:16:14.643922 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 545/1043] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:14 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:15.394444 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f9e89823-b6bb-43cf-9fae-58b227442bfe tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:15.395287 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f9e89823-b6bb-43cf-9fae-58b227442bfe tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:15.401986 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f9e89823-b6bb-43cf-9fae-58b227442bfe tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:15.402431 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f9e89823-b6bb-43cf-9fae-58b227442bfe tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:15.403189 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f9e89823-b6bb-43cf-9fae-58b227442bfe tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:15.403619 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f9e89823-b6bb-43cf-9fae-58b227442bfe tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:15.432092 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f9e89823-b6bb-43cf-9fae-58b227442bfe tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042234 Jun 22 09:16:15.432632 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 499/1044] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:15 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:15.661315 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-40468eba-4c26-44b4-a54a-c43404507317 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:15.661832 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-40468eba-4c26-44b4-a54a-c43404507317 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:15.668342 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-40468eba-4c26-44b4-a54a-c43404507317 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:15.668799 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-40468eba-4c26-44b4-a54a-c43404507317 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:15.669562 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-40468eba-4c26-44b4-a54a-c43404507317 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:15.670014 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-40468eba-4c26-44b4-a54a-c43404507317 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:15.796828 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-40468eba-4c26-44b4-a54a-c43404507317 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:15.804821 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-40468eba-4c26-44b4-a54a-c43404507317 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.148039 Jun 22 09:16:15.805386 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 546/1045] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:15 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:16.444338 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ef58776f-0a30-4e91-82c8-97c2acc35a6d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:16.445393 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ef58776f-0a30-4e91-82c8-97c2acc35a6d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:16.447714 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=60 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:16.452393 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ef58776f-0a30-4e91-82c8-97c2acc35a6d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:16.452880 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ef58776f-0a30-4e91-82c8-97c2acc35a6d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:16.453648 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ef58776f-0a30-4e91-82c8-97c2acc35a6d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:16.454093 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ef58776f-0a30-4e91-82c8-97c2acc35a6d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:16.482956 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ef58776f-0a30-4e91-82c8-97c2acc35a6d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043321 Jun 22 09:16:16.483438 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 500/1046] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:16 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:16.822821 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-fa6d1beb-7ea2-4b1e-b6a7-27e165999a58 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:16.823432 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-fa6d1beb-7ea2-4b1e-b6a7-27e165999a58 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:16.829878 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fa6d1beb-7ea2-4b1e-b6a7-27e165999a58 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:16.830320 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fa6d1beb-7ea2-4b1e-b6a7-27e165999a58 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:16.831825 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fa6d1beb-7ea2-4b1e-b6a7-27e165999a58 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:16.832257 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fa6d1beb-7ea2-4b1e-b6a7-27e165999a58 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:16.964052 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-fa6d1beb-7ea2-4b1e-b6a7-27e165999a58 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:16.972262 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-fa6d1beb-7ea2-4b1e-b6a7-27e165999a58 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.153240 Jun 22 09:16:16.976725 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 547/1047] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:16 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:17.494508 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-77b605c5-a276-46f3-aaba-9db4f183ace9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:17.495423 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-77b605c5-a276-46f3-aaba-9db4f183ace9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:17.502277 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-77b605c5-a276-46f3-aaba-9db4f183ace9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:17.502729 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-77b605c5-a276-46f3-aaba-9db4f183ace9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:17.503878 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-77b605c5-a276-46f3-aaba-9db4f183ace9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:17.504333 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-77b605c5-a276-46f3-aaba-9db4f183ace9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:17.529871 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=100 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:17.534897 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-77b605c5-a276-46f3-aaba-9db4f183ace9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044468 Jun 22 09:16:17.535447 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 501/1048] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:17 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:17.991874 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f1dd3af2-b5d5-45c4-8312-9eccb4a3c7c0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:17.992524 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-f1dd3af2-b5d5-45c4-8312-9eccb4a3c7c0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:17.999093 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f1dd3af2-b5d5-45c4-8312-9eccb4a3c7c0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:17.999541 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f1dd3af2-b5d5-45c4-8312-9eccb4a3c7c0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:18.000309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f1dd3af2-b5d5-45c4-8312-9eccb4a3c7c0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:18.000748 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f1dd3af2-b5d5-45c4-8312-9eccb4a3c7c0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:18.125515 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-f1dd3af2-b5d5-45c4-8312-9eccb4a3c7c0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:18.133898 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f1dd3af2-b5d5-45c4-8312-9eccb4a3c7c0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.145867 Jun 22 09:16:18.134453 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 548/1049] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:17 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:18.546499 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-acfbb983-5455-4221-903a-ead436f57748 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:18.547417 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-acfbb983-5455-4221-903a-ead436f57748 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:18.554895 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-acfbb983-5455-4221-903a-ead436f57748 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:18.555347 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-acfbb983-5455-4221-903a-ead436f57748 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:18.556526 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-acfbb983-5455-4221-903a-ead436f57748 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:18.556817 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-acfbb983-5455-4221-903a-ead436f57748 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:18.585607 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-acfbb983-5455-4221-903a-ead436f57748 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042882 Jun 22 09:16:18.586156 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 502/1050] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:18 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:19.151511 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-478b7307-1a21-4cf8-8f0c-305a4c537700 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:19.152117 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-478b7307-1a21-4cf8-8f0c-305a4c537700 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:19.159157 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-478b7307-1a21-4cf8-8f0c-305a4c537700 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:19.159612 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-478b7307-1a21-4cf8-8f0c-305a4c537700 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:19.160368 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-478b7307-1a21-4cf8-8f0c-305a4c537700 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:19.160823 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-478b7307-1a21-4cf8-8f0c-305a4c537700 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:19.292282 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-478b7307-1a21-4cf8-8f0c-305a4c537700 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:19.301417 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-478b7307-1a21-4cf8-8f0c-305a4c537700 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.153983 Jun 22 09:16:19.308332 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 549/1051] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:19 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:19.597346 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-5f4bfcc8-3d89-4561-b828-3f26f4930d4b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:19.598262 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-5f4bfcc8-3d89-4561-b828-3f26f4930d4b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:19.604638 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5f4bfcc8-3d89-4561-b828-3f26f4930d4b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:19.605111 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5f4bfcc8-3d89-4561-b828-3f26f4930d4b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:19.605863 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5f4bfcc8-3d89-4561-b828-3f26f4930d4b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:19.606294 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5f4bfcc8-3d89-4561-b828-3f26f4930d4b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:19.635769 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-5f4bfcc8-3d89-4561-b828-3f26f4930d4b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042364 Jun 22 09:16:19.636254 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 503/1052] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:19 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:20.318358 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-52c8c038-5846-4b3e-841c-02c0b38f4809 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:20.318981 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-52c8c038-5846-4b3e-841c-02c0b38f4809 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:20.326165 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-52c8c038-5846-4b3e-841c-02c0b38f4809 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:20.326612 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-52c8c038-5846-4b3e-841c-02c0b38f4809 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:20.327370 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-52c8c038-5846-4b3e-841c-02c0b38f4809 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:20.327805 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-52c8c038-5846-4b3e-841c-02c0b38f4809 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:20.458256 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-52c8c038-5846-4b3e-841c-02c0b38f4809 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:20.466078 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-52c8c038-5846-4b3e-841c-02c0b38f4809 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.151709 Jun 22 09:16:20.466628 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 550/1053] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:20 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:20.647959 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6b995eb6-0ada-45b2-9c3f-e6ba91a17a03 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:20.648851 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-6b995eb6-0ada-45b2-9c3f-e6ba91a17a03 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:20.655229 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6b995eb6-0ada-45b2-9c3f-e6ba91a17a03 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:20.655679 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6b995eb6-0ada-45b2-9c3f-e6ba91a17a03 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:20.656429 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6b995eb6-0ada-45b2-9c3f-e6ba91a17a03 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:20.656889 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6b995eb6-0ada-45b2-9c3f-e6ba91a17a03 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:20.840024 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-6b995eb6-0ada-45b2-9c3f-e6ba91a17a03 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.196011 Jun 22 09:16:20.840568 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 504/1054] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:20 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:21.483244 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-48fd6d2e-d1a0-4958-832e-b416e359e628 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:21.483859 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-48fd6d2e-d1a0-4958-832e-b416e359e628 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:21.490503 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-48fd6d2e-d1a0-4958-832e-b416e359e628 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:21.490952 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-48fd6d2e-d1a0-4958-832e-b416e359e628 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:21.491711 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-48fd6d2e-d1a0-4958-832e-b416e359e628 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:21.492158 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-48fd6d2e-d1a0-4958-832e-b416e359e628 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:21.620217 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-48fd6d2e-d1a0-4958-832e-b416e359e628 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:21.628865 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-48fd6d2e-d1a0-4958-832e-b416e359e628 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149385 Jun 22 09:16:21.629365 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 551/1055] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:21 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:21.852233 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f9aa4c7b-7fda-4d91-b42d-d081f340da1c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:21.853172 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f9aa4c7b-7fda-4d91-b42d-d081f340da1c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:21.859664 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f9aa4c7b-7fda-4d91-b42d-d081f340da1c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:21.860109 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f9aa4c7b-7fda-4d91-b42d-d081f340da1c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:21.860878 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f9aa4c7b-7fda-4d91-b42d-d081f340da1c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:21.861313 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f9aa4c7b-7fda-4d91-b42d-d081f340da1c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:21.890354 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f9aa4c7b-7fda-4d91-b42d-d081f340da1c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041976 Jun 22 09:16:21.890820 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 505/1056] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:21 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:22.645865 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-47d00e5c-a6aa-4ed8-9a3a-69fda6ce2aa1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:22.646519 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-47d00e5c-a6aa-4ed8-9a3a-69fda6ce2aa1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:22.653198 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-47d00e5c-a6aa-4ed8-9a3a-69fda6ce2aa1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:22.653650 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-47d00e5c-a6aa-4ed8-9a3a-69fda6ce2aa1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:22.654413 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-47d00e5c-a6aa-4ed8-9a3a-69fda6ce2aa1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:22.654852 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-47d00e5c-a6aa-4ed8-9a3a-69fda6ce2aa1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:22.782615 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-47d00e5c-a6aa-4ed8-9a3a-69fda6ce2aa1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:22.790593 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-47d00e5c-a6aa-4ed8-9a3a-69fda6ce2aa1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.148775 Jun 22 09:16:22.798648 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 552/1057] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:22 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:22.902633 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ff624053-0a3b-4c9e-98ea-8644d80219d3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:22.903551 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ff624053-0a3b-4c9e-98ea-8644d80219d3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:22.910443 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ff624053-0a3b-4c9e-98ea-8644d80219d3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:22.910929 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ff624053-0a3b-4c9e-98ea-8644d80219d3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:22.911692 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ff624053-0a3b-4c9e-98ea-8644d80219d3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:22.912131 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ff624053-0a3b-4c9e-98ea-8644d80219d3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:22.941319 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ff624053-0a3b-4c9e-98ea-8644d80219d3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042830 Jun 22 09:16:22.941856 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 506/1058] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:22 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:23.808195 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-4af0488c-8314-4fc4-9390-5c2c629e63bc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:23.808847 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-4af0488c-8314-4fc4-9390-5c2c629e63bc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:23.815488 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4af0488c-8314-4fc4-9390-5c2c629e63bc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:23.815932 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4af0488c-8314-4fc4-9390-5c2c629e63bc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:23.816686 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4af0488c-8314-4fc4-9390-5c2c629e63bc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:23.817172 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4af0488c-8314-4fc4-9390-5c2c629e63bc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:23.943722 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-4af0488c-8314-4fc4-9390-5c2c629e63bc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:23.952049 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-4af0488c-8314-4fc4-9390-5c2c629e63bc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.147719 Jun 22 09:16:23.952619 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 553/1059] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:23 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:23.952750 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-d0dd1529-db29-4046-af91-51e6d94adc99 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:23.953604 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-d0dd1529-db29-4046-af91-51e6d94adc99 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:23.960558 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d0dd1529-db29-4046-af91-51e6d94adc99 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:23.961033 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d0dd1529-db29-4046-af91-51e6d94adc99 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:23.961789 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d0dd1529-db29-4046-af91-51e6d94adc99 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:23.962223 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d0dd1529-db29-4046-af91-51e6d94adc99 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:24.001255 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-d0dd1529-db29-4046-af91-51e6d94adc99 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052377 Jun 22 09:16:24.001813 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 507/1060] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:23 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:16:24.969747 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-95455844-4f5b-4925-acac-4a3e679a50bd tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:24.970356 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-95455844-4f5b-4925-acac-4a3e679a50bd tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:24.977432 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-95455844-4f5b-4925-acac-4a3e679a50bd tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:24.977878 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-95455844-4f5b-4925-acac-4a3e679a50bd tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:24.978629 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-95455844-4f5b-4925-acac-4a3e679a50bd tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:24.979061 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-95455844-4f5b-4925-acac-4a3e679a50bd tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:25.015427 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-47f12fdd-8796-4ad0-990a-13ff616c583e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:25.016411 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-47f12fdd-8796-4ad0-990a-13ff616c583e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:25.023007 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-47f12fdd-8796-4ad0-990a-13ff616c583e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:25.023461 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-47f12fdd-8796-4ad0-990a-13ff616c583e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:25.024492 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-47f12fdd-8796-4ad0-990a-13ff616c583e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:25.025009 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-47f12fdd-8796-4ad0-990a-13ff616c583e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:25.060360 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-47f12fdd-8796-4ad0-990a-13ff616c583e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048764 Jun 22 09:16:25.063050 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 508/1061] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:25 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:16:25.119851 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-95455844-4f5b-4925-acac-4a3e679a50bd tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:25.128351 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-95455844-4f5b-4925-acac-4a3e679a50bd tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.162423 Jun 22 09:16:25.128974 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 554/1062] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:24 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:26.073851 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-7bc2c96e-af89-4956-ac2b-e5316378eda3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:26.074772 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-7bc2c96e-af89-4956-ac2b-e5316378eda3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:26.081728 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7bc2c96e-af89-4956-ac2b-e5316378eda3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:26.082194 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7bc2c96e-af89-4956-ac2b-e5316378eda3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:26.082948 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7bc2c96e-af89-4956-ac2b-e5316378eda3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:26.083384 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7bc2c96e-af89-4956-ac2b-e5316378eda3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:26.111631 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-7bc2c96e-af89-4956-ac2b-e5316378eda3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041682 Jun 22 09:16:26.112161 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 509/1063] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:26 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:26.145896 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-be21e8db-3a91-4872-9ad6-f947de366413 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:26.146506 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-be21e8db-3a91-4872-9ad6-f947de366413 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:26.153270 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-be21e8db-3a91-4872-9ad6-f947de366413 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:26.153721 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-be21e8db-3a91-4872-9ad6-f947de366413 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:26.154482 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-be21e8db-3a91-4872-9ad6-f947de366413 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:26.154937 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-be21e8db-3a91-4872-9ad6-f947de366413 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:26.321793 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=100 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:26.445037 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-be21e8db-3a91-4872-9ad6-f947de366413 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:26.453508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-be21e8db-3a91-4872-9ad6-f947de366413 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.312044 Jun 22 09:16:26.454425 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 555/1064] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:26 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:27.123401 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c0f88b6d-77b8-49b2-bbaa-5432a464f07b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:27.124267 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c0f88b6d-77b8-49b2-bbaa-5432a464f07b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:27.131429 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c0f88b6d-77b8-49b2-bbaa-5432a464f07b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:27.131873 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c0f88b6d-77b8-49b2-bbaa-5432a464f07b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:27.132631 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c0f88b6d-77b8-49b2-bbaa-5432a464f07b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:27.133089 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c0f88b6d-77b8-49b2-bbaa-5432a464f07b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:27.163496 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c0f88b6d-77b8-49b2-bbaa-5432a464f07b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044160 Jun 22 09:16:27.164031 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 510/1065] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:27 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:27.471955 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2580c121-b756-4f1b-88a3-6cfa3770ec32 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:27.472527 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2580c121-b756-4f1b-88a3-6cfa3770ec32 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:27.478890 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2580c121-b756-4f1b-88a3-6cfa3770ec32 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:27.479334 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2580c121-b756-4f1b-88a3-6cfa3770ec32 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:27.480086 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2580c121-b756-4f1b-88a3-6cfa3770ec32 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:27.480520 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2580c121-b756-4f1b-88a3-6cfa3770ec32 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:27.614728 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-2580c121-b756-4f1b-88a3-6cfa3770ec32 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:27.622797 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2580c121-b756-4f1b-88a3-6cfa3770ec32 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.155336 Jun 22 09:16:27.623357 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 556/1066] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:27 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:16:28.175079 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c9249cdd-e702-42db-9719-e05ee1daf923 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:28.175995 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c9249cdd-e702-42db-9719-e05ee1daf923 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:28.182549 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c9249cdd-e702-42db-9719-e05ee1daf923 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:28.183001 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c9249cdd-e702-42db-9719-e05ee1daf923 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:28.183791 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c9249cdd-e702-42db-9719-e05ee1daf923 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:28.184228 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c9249cdd-e702-42db-9719-e05ee1daf923 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:28.213870 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c9249cdd-e702-42db-9719-e05ee1daf923 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043324 Jun 22 09:16:28.214422 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 511/1067] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:28 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:28.639540 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c0eea041-c8c8-4a3f-85c4-c2ee2bc53014 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:28.640264 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c0eea041-c8c8-4a3f-85c4-c2ee2bc53014 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:28.647116 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c0eea041-c8c8-4a3f-85c4-c2ee2bc53014 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:28.647569 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c0eea041-c8c8-4a3f-85c4-c2ee2bc53014 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:28.648508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c0eea041-c8c8-4a3f-85c4-c2ee2bc53014 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:28.649287 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c0eea041-c8c8-4a3f-85c4-c2ee2bc53014 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:28.783020 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c0eea041-c8c8-4a3f-85c4-c2ee2bc53014 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:28.791114 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c0eea041-c8c8-4a3f-85c4-c2ee2bc53014 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.155492 Jun 22 09:16:28.791683 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 557/1068] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:28 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:29.225826 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-03a3064b-6ac5-43a9-a47c-355a3f665356 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:29.226745 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-03a3064b-6ac5-43a9-a47c-355a3f665356 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:29.233179 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-03a3064b-6ac5-43a9-a47c-355a3f665356 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:29.233624 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-03a3064b-6ac5-43a9-a47c-355a3f665356 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:29.234371 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-03a3064b-6ac5-43a9-a47c-355a3f665356 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:29.234826 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-03a3064b-6ac5-43a9-a47c-355a3f665356 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:29.264134 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-03a3064b-6ac5-43a9-a47c-355a3f665356 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042142 Jun 22 09:16:29.264927 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 512/1069] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:29 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:29.808859 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-79caacd8-4825-407f-92b6-b33a2b9962b6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:29.809552 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-79caacd8-4825-407f-92b6-b33a2b9962b6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:29.816592 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-79caacd8-4825-407f-92b6-b33a2b9962b6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:29.817307 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-79caacd8-4825-407f-92b6-b33a2b9962b6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:29.818119 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-79caacd8-4825-407f-92b6-b33a2b9962b6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:29.818511 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-79caacd8-4825-407f-92b6-b33a2b9962b6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:29.945626 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-79caacd8-4825-407f-92b6-b33a2b9962b6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:29.953940 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-79caacd8-4825-407f-92b6-b33a2b9962b6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.148913 Jun 22 09:16:29.954489 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 558/1070] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:29 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:30.275810 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-93021523-bef6-4df5-8ff2-7acf7cf6e0d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:30.276729 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-93021523-bef6-4df5-8ff2-7acf7cf6e0d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:30.283674 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-93021523-bef6-4df5-8ff2-7acf7cf6e0d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:30.284206 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-93021523-bef6-4df5-8ff2-7acf7cf6e0d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:30.284990 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-93021523-bef6-4df5-8ff2-7acf7cf6e0d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:30.285430 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-93021523-bef6-4df5-8ff2-7acf7cf6e0d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:30.313912 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-93021523-bef6-4df5-8ff2-7acf7cf6e0d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042306 Jun 22 09:16:30.314605 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 513/1071] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:30 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:30.971427 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e9fc8014-571b-494d-8612-16ffae0abe4f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:30.972073 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e9fc8014-571b-494d-8612-16ffae0abe4f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:30.978622 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e9fc8014-571b-494d-8612-16ffae0abe4f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:30.979065 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e9fc8014-571b-494d-8612-16ffae0abe4f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:30.979813 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e9fc8014-571b-494d-8612-16ffae0abe4f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:30.980245 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e9fc8014-571b-494d-8612-16ffae0abe4f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:31.108974 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-e9fc8014-571b-494d-8612-16ffae0abe4f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:31.116989 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e9fc8014-571b-494d-8612-16ffae0abe4f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149547 Jun 22 09:16:31.117536 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 559/1072] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:30 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:31.325382 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-dc2d263a-cbbf-46f2-b847-420751675901 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:31.326260 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-dc2d263a-cbbf-46f2-b847-420751675901 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:31.333546 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dc2d263a-cbbf-46f2-b847-420751675901 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:31.334001 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dc2d263a-cbbf-46f2-b847-420751675901 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:31.334769 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dc2d263a-cbbf-46f2-b847-420751675901 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:31.335207 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dc2d263a-cbbf-46f2-b847-420751675901 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:31.364636 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-dc2d263a-cbbf-46f2-b847-420751675901 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043283 Jun 22 09:16:31.365219 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 514/1073] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:31 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:32.134673 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a9dda6d8-0950-49ca-9a77-f78e35aca051 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:32.135262 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-a9dda6d8-0950-49ca-9a77-f78e35aca051 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:32.145229 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a9dda6d8-0950-49ca-9a77-f78e35aca051 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:32.145938 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a9dda6d8-0950-49ca-9a77-f78e35aca051 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:32.147204 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a9dda6d8-0950-49ca-9a77-f78e35aca051 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:32.147860 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a9dda6d8-0950-49ca-9a77-f78e35aca051 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:32.288551 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-a9dda6d8-0950-49ca-9a77-f78e35aca051 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:32.296710 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a9dda6d8-0950-49ca-9a77-f78e35aca051 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.166685 Jun 22 09:16:32.297290 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 560/1074] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:32 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:32.375691 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-40bc5a61-9fa4-4302-a9d2-d3e53a33b09e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:32.376842 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-40bc5a61-9fa4-4302-a9d2-d3e53a33b09e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:32.383708 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-40bc5a61-9fa4-4302-a9d2-d3e53a33b09e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:32.384162 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-40bc5a61-9fa4-4302-a9d2-d3e53a33b09e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:32.385040 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-40bc5a61-9fa4-4302-a9d2-d3e53a33b09e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:32.385428 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-40bc5a61-9fa4-4302-a9d2-d3e53a33b09e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:32.415975 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-40bc5a61-9fa4-4302-a9d2-d3e53a33b09e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044284 Jun 22 09:16:32.416545 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 515/1075] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:32 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:33.315150 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-07697ac7-e417-4caf-a0bd-fd473b9a2b61 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:33.315760 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-07697ac7-e417-4caf-a0bd-fd473b9a2b61 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:33.322228 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-07697ac7-e417-4caf-a0bd-fd473b9a2b61 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:33.322675 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-07697ac7-e417-4caf-a0bd-fd473b9a2b61 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:33.323433 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-07697ac7-e417-4caf-a0bd-fd473b9a2b61 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:33.323871 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-07697ac7-e417-4caf-a0bd-fd473b9a2b61 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:33.427130 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-13cc0ad5-653b-4f53-9dbd-ff04ca99c671 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:33.428101 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-13cc0ad5-653b-4f53-9dbd-ff04ca99c671 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:33.434524 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-13cc0ad5-653b-4f53-9dbd-ff04ca99c671 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:33.434981 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-13cc0ad5-653b-4f53-9dbd-ff04ca99c671 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:33.435745 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-13cc0ad5-653b-4f53-9dbd-ff04ca99c671 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:33.436169 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-13cc0ad5-653b-4f53-9dbd-ff04ca99c671 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:33.455699 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-07697ac7-e417-4caf-a0bd-fd473b9a2b61 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:33.464087 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-07697ac7-e417-4caf-a0bd-fd473b9a2b61 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.152927 Jun 22 09:16:33.464712 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 561/1076] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:33 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:33.465483 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-13cc0ad5-653b-4f53-9dbd-ff04ca99c671 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042313 Jun 22 09:16:33.466031 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 516/1077] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:33 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:16:34.477411 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-94505606-63cf-4733-b8c6-5e3cb6435731 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:34.478265 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-94505606-63cf-4733-b8c6-5e3cb6435731 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:34.481412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-07bca09a-2506-46cb-a49a-fe6f7ab516d2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:34.482023 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-07bca09a-2506-46cb-a49a-fe6f7ab516d2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:34.484829 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-94505606-63cf-4733-b8c6-5e3cb6435731 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:34.485285 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-94505606-63cf-4733-b8c6-5e3cb6435731 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:34.486683 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-94505606-63cf-4733-b8c6-5e3cb6435731 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:34.487308 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-94505606-63cf-4733-b8c6-5e3cb6435731 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:34.489252 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-07bca09a-2506-46cb-a49a-fe6f7ab516d2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:34.489699 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-07bca09a-2506-46cb-a49a-fe6f7ab516d2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:34.490454 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-07bca09a-2506-46cb-a49a-fe6f7ab516d2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:34.490893 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-07bca09a-2506-46cb-a49a-fe6f7ab516d2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:34.516253 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-94505606-63cf-4733-b8c6-5e3cb6435731 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042838 Jun 22 09:16:34.516817 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 562/1078] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:34 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:34.668428 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-07bca09a-2506-46cb-a49a-fe6f7ab516d2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:34.676410 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-07bca09a-2506-46cb-a49a-fe6f7ab516d2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.198838 Jun 22 09:16:34.676997 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 517/1079] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:34 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:16:35.528890 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-8dd8156c-a5a0-43f7-8de6-814324f334d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:35.529761 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-8dd8156c-a5a0-43f7-8de6-814324f334d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:35.536739 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8dd8156c-a5a0-43f7-8de6-814324f334d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:35.537218 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8dd8156c-a5a0-43f7-8de6-814324f334d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:35.537979 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8dd8156c-a5a0-43f7-8de6-814324f334d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:35.538418 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8dd8156c-a5a0-43f7-8de6-814324f334d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:35.567085 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-8dd8156c-a5a0-43f7-8de6-814324f334d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042290 Jun 22 09:16:35.567628 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 563/1080] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:35 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:35.693832 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-197644b9-485c-4089-82b7-e47d6c403170 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:35.694434 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-197644b9-485c-4089-82b7-e47d6c403170 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:35.701095 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-197644b9-485c-4089-82b7-e47d6c403170 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:35.701540 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-197644b9-485c-4089-82b7-e47d6c403170 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:35.702298 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-197644b9-485c-4089-82b7-e47d6c403170 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:35.702727 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-197644b9-485c-4089-82b7-e47d6c403170 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:35.718192 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=100 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:35.835777 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-197644b9-485c-4089-82b7-e47d6c403170 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:35.843648 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-197644b9-485c-4089-82b7-e47d6c403170 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.153669 Jun 22 09:16:35.844206 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 518/1081] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:35 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:16:36.578565 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2f1935a2-7966-40ce-92c8-070730b59690 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:36.580383 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2f1935a2-7966-40ce-92c8-070730b59690 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:36.586631 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2f1935a2-7966-40ce-92c8-070730b59690 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:36.587075 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2f1935a2-7966-40ce-92c8-070730b59690 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:36.587823 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2f1935a2-7966-40ce-92c8-070730b59690 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:36.588256 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2f1935a2-7966-40ce-92c8-070730b59690 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:36.616884 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2f1935a2-7966-40ce-92c8-070730b59690 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042134 Jun 22 09:16:36.617411 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 564/1082] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:36 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:36.861894 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f5756b15-eeba-4eb1-b7be-2cb7f05c05a5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:36.862511 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f5756b15-eeba-4eb1-b7be-2cb7f05c05a5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:36.868968 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f5756b15-eeba-4eb1-b7be-2cb7f05c05a5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:36.869415 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f5756b15-eeba-4eb1-b7be-2cb7f05c05a5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:36.870174 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f5756b15-eeba-4eb1-b7be-2cb7f05c05a5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:36.870608 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f5756b15-eeba-4eb1-b7be-2cb7f05c05a5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:37.000123 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-f5756b15-eeba-4eb1-b7be-2cb7f05c05a5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:37.009110 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f5756b15-eeba-4eb1-b7be-2cb7f05c05a5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.151903 Jun 22 09:16:37.009848 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 519/1083] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:36 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:37.094790 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:16:37.094970 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Wed Jun 22 09:16:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:16:37.628052 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-3c36e0a3-c585-4981-9872-e77a324ac049 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:37.628955 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-3c36e0a3-c585-4981-9872-e77a324ac049 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:37.635432 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3c36e0a3-c585-4981-9872-e77a324ac049 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:37.635887 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3c36e0a3-c585-4981-9872-e77a324ac049 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:37.636646 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3c36e0a3-c585-4981-9872-e77a324ac049 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:37.637113 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3c36e0a3-c585-4981-9872-e77a324ac049 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:37.666348 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-3c36e0a3-c585-4981-9872-e77a324ac049 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042340 Jun 22 09:16:37.666878 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 565/1084] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:37 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:38.026637 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-2d1784a8-7225-498c-9f58-1bc0ed7c0d24 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:38.027181 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-2d1784a8-7225-498c-9f58-1bc0ed7c0d24 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:38.034307 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2d1784a8-7225-498c-9f58-1bc0ed7c0d24 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:38.034755 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2d1784a8-7225-498c-9f58-1bc0ed7c0d24 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:38.035537 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2d1784a8-7225-498c-9f58-1bc0ed7c0d24 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:38.035974 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2d1784a8-7225-498c-9f58-1bc0ed7c0d24 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:38.165754 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-2d1784a8-7225-498c-9f58-1bc0ed7c0d24 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:38.174037 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-2d1784a8-7225-498c-9f58-1bc0ed7c0d24 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.151604 Jun 22 09:16:38.174594 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 520/1085] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:38 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:38.678371 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-afef8c4c-2918-4317-901f-cc41100376ab tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:38.679210 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-afef8c4c-2918-4317-901f-cc41100376ab tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:38.686078 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-afef8c4c-2918-4317-901f-cc41100376ab tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:38.686536 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-afef8c4c-2918-4317-901f-cc41100376ab tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:38.687341 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-afef8c4c-2918-4317-901f-cc41100376ab tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:38.687790 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-afef8c4c-2918-4317-901f-cc41100376ab tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:38.718017 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-afef8c4c-2918-4317-901f-cc41100376ab tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043632 Jun 22 09:16:38.718561 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 566/1086] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:38 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:39.191335 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-71743dab-dfd8-4c58-824f-dc3caa7ea076 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:39.191942 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-71743dab-dfd8-4c58-824f-dc3caa7ea076 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:39.198922 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-71743dab-dfd8-4c58-824f-dc3caa7ea076 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:39.199376 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-71743dab-dfd8-4c58-824f-dc3caa7ea076 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:39.200148 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-71743dab-dfd8-4c58-824f-dc3caa7ea076 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:39.200587 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-71743dab-dfd8-4c58-824f-dc3caa7ea076 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:39.331872 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-71743dab-dfd8-4c58-824f-dc3caa7ea076 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:39.339755 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-71743dab-dfd8-4c58-824f-dc3caa7ea076 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.152890 Jun 22 09:16:39.340311 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 521/1087] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:39 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:39.730206 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2e7a6f04-ff9c-4faa-b3ed-3574d7877cc7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:39.731050 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2e7a6f04-ff9c-4faa-b3ed-3574d7877cc7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:39.738090 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2e7a6f04-ff9c-4faa-b3ed-3574d7877cc7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:39.738534 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2e7a6f04-ff9c-4faa-b3ed-3574d7877cc7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:39.739295 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2e7a6f04-ff9c-4faa-b3ed-3574d7877cc7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:39.739725 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2e7a6f04-ff9c-4faa-b3ed-3574d7877cc7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:39.767549 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2e7a6f04-ff9c-4faa-b3ed-3574d7877cc7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041385 Jun 22 09:16:39.768063 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 567/1088] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:39 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:40.356874 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-fd01fb92-26e9-4fcd-95fb-2b638717d501 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:40.357494 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-fd01fb92-26e9-4fcd-95fb-2b638717d501 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:40.364431 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fd01fb92-26e9-4fcd-95fb-2b638717d501 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:40.364907 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fd01fb92-26e9-4fcd-95fb-2b638717d501 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:40.365664 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fd01fb92-26e9-4fcd-95fb-2b638717d501 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:40.366099 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fd01fb92-26e9-4fcd-95fb-2b638717d501 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:40.494453 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-fd01fb92-26e9-4fcd-95fb-2b638717d501 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:40.502896 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-fd01fb92-26e9-4fcd-95fb-2b638717d501 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149868 Jun 22 09:16:40.503473 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 522/1089] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:40 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:40.778924 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9c4971cf-a870-469b-ab04-bcb9b756e905 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:40.779772 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9c4971cf-a870-469b-ab04-bcb9b756e905 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:40.787113 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9c4971cf-a870-469b-ab04-bcb9b756e905 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:40.787562 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9c4971cf-a870-469b-ab04-bcb9b756e905 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:40.788317 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9c4971cf-a870-469b-ab04-bcb9b756e905 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:40.788755 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9c4971cf-a870-469b-ab04-bcb9b756e905 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:40.817635 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9c4971cf-a870-469b-ab04-bcb9b756e905 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042780 Jun 22 09:16:40.818168 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 568/1090] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:40 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:41.519555 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-5eb54635-9bf8-4d2f-80d2-11febab099a3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:41.520166 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-5eb54635-9bf8-4d2f-80d2-11febab099a3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:41.526926 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5eb54635-9bf8-4d2f-80d2-11febab099a3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:41.527377 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5eb54635-9bf8-4d2f-80d2-11febab099a3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:41.528136 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5eb54635-9bf8-4d2f-80d2-11febab099a3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:41.528566 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5eb54635-9bf8-4d2f-80d2-11febab099a3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:41.665554 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-5eb54635-9bf8-4d2f-80d2-11febab099a3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:41.673782 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-5eb54635-9bf8-4d2f-80d2-11febab099a3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.157924 Jun 22 09:16:41.674275 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 523/1091] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:41 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:41.829057 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-34d13ca5-1412-44d9-8e6f-2f81995a680c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:41.830662 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-34d13ca5-1412-44d9-8e6f-2f81995a680c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:41.833117 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=54 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:41.837846 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-34d13ca5-1412-44d9-8e6f-2f81995a680c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:41.838294 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-34d13ca5-1412-44d9-8e6f-2f81995a680c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:41.839077 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-34d13ca5-1412-44d9-8e6f-2f81995a680c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:41.839517 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-34d13ca5-1412-44d9-8e6f-2f81995a680c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:41.869385 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-34d13ca5-1412-44d9-8e6f-2f81995a680c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044264 Jun 22 09:16:41.869923 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 569/1092] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:41 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:42.690182 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-9387288a-b9fb-4a4b-9a96-e54de4fae089 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:42.690824 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-9387288a-b9fb-4a4b-9a96-e54de4fae089 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:42.697443 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9387288a-b9fb-4a4b-9a96-e54de4fae089 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:42.697888 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9387288a-b9fb-4a4b-9a96-e54de4fae089 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:42.698707 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9387288a-b9fb-4a4b-9a96-e54de4fae089 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:42.699143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9387288a-b9fb-4a4b-9a96-e54de4fae089 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:42.824285 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-9387288a-b9fb-4a4b-9a96-e54de4fae089 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:42.832552 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-9387288a-b9fb-4a4b-9a96-e54de4fae089 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.146316 Jun 22 09:16:42.833078 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 524/1093] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:42 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:42.881052 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-225ac4c5-8215-404d-8cd4-0711ece89132 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:42.882063 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-225ac4c5-8215-404d-8cd4-0711ece89132 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:42.888495 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-225ac4c5-8215-404d-8cd4-0711ece89132 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:42.888995 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-225ac4c5-8215-404d-8cd4-0711ece89132 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:42.889752 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-225ac4c5-8215-404d-8cd4-0711ece89132 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:42.890193 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-225ac4c5-8215-404d-8cd4-0711ece89132 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:42.919231 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-225ac4c5-8215-404d-8cd4-0711ece89132 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042220 Jun 22 09:16:42.919770 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 570/1094] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:42 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:43.849369 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-2edc84d1-2c70-4038-858d-74cce4846ad0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:43.849981 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-2edc84d1-2c70-4038-858d-74cce4846ad0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:43.856764 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2edc84d1-2c70-4038-858d-74cce4846ad0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:43.857237 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2edc84d1-2c70-4038-858d-74cce4846ad0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:43.857985 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2edc84d1-2c70-4038-858d-74cce4846ad0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:43.858417 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2edc84d1-2c70-4038-858d-74cce4846ad0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:43.930896 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-cf792a90-9c44-4601-83dc-b2d2c47f9922 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:43.931737 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-cf792a90-9c44-4601-83dc-b2d2c47f9922 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:43.938392 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cf792a90-9c44-4601-83dc-b2d2c47f9922 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:43.939511 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cf792a90-9c44-4601-83dc-b2d2c47f9922 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:43.940284 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cf792a90-9c44-4601-83dc-b2d2c47f9922 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:43.940734 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cf792a90-9c44-4601-83dc-b2d2c47f9922 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:43.971034 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-cf792a90-9c44-4601-83dc-b2d2c47f9922 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044121 Jun 22 09:16:43.971590 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 571/1095] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:43 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:16:43.988314 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-2edc84d1-2c70-4038-858d-74cce4846ad0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:43.996228 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-2edc84d1-2c70-4038-858d-74cce4846ad0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.150936 Jun 22 09:16:43.996808 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 525/1096] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:43 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:44.982985 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-1585d92e-84aa-44f3-85e6-3b978ece81bf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:44.983942 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-1585d92e-84aa-44f3-85e6-3b978ece81bf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:44.990785 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1585d92e-84aa-44f3-85e6-3b978ece81bf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:44.991236 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1585d92e-84aa-44f3-85e6-3b978ece81bf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:44.991996 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1585d92e-84aa-44f3-85e6-3b978ece81bf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:44.992436 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1585d92e-84aa-44f3-85e6-3b978ece81bf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:44.996019 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=100 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:45.013927 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-e5a0bc16-1b8e-47e3-98cd-835c3b2df897 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:45.014540 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-e5a0bc16-1b8e-47e3-98cd-835c3b2df897 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:45.028843 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-1585d92e-84aa-44f3-85e6-3b978ece81bf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041909 Jun 22 09:16:45.028995 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e5a0bc16-1b8e-47e3-98cd-835c3b2df897 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:45.028995 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e5a0bc16-1b8e-47e3-98cd-835c3b2df897 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:45.029203 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 572/1097] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:44 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:45.029310 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e5a0bc16-1b8e-47e3-98cd-835c3b2df897 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:45.029310 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e5a0bc16-1b8e-47e3-98cd-835c3b2df897 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:45.151998 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-e5a0bc16-1b8e-47e3-98cd-835c3b2df897 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:45.160610 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-e5a0bc16-1b8e-47e3-98cd-835c3b2df897 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.150482 Jun 22 09:16:45.161203 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 526/1098] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:45 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:16:46.039483 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-fbf1b7ab-9933-45c6-8cdb-ad90fec3af22 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:46.040420 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-fbf1b7ab-9933-45c6-8cdb-ad90fec3af22 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:46.047654 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fbf1b7ab-9933-45c6-8cdb-ad90fec3af22 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:46.049365 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fbf1b7ab-9933-45c6-8cdb-ad90fec3af22 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:46.050145 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fbf1b7ab-9933-45c6-8cdb-ad90fec3af22 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:46.050594 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fbf1b7ab-9933-45c6-8cdb-ad90fec3af22 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:46.078704 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-fbf1b7ab-9933-45c6-8cdb-ad90fec3af22 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043425 Jun 22 09:16:46.079755 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 573/1099] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:46 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:46.178053 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-8e303df7-8c95-42e6-bdaa-822b3c629bdf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:46.178658 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-8e303df7-8c95-42e6-bdaa-822b3c629bdf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:46.185105 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8e303df7-8c95-42e6-bdaa-822b3c629bdf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:46.185551 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8e303df7-8c95-42e6-bdaa-822b3c629bdf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:46.186303 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8e303df7-8c95-42e6-bdaa-822b3c629bdf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:46.186735 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8e303df7-8c95-42e6-bdaa-822b3c629bdf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:46.315585 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-8e303df7-8c95-42e6-bdaa-822b3c629bdf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:46.323544 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-8e303df7-8c95-42e6-bdaa-822b3c629bdf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149311 Jun 22 09:16:46.324111 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 527/1100] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:46 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:47.089680 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7de1b208-8067-4da3-be9d-f4a76f481ef7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:47.090546 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7de1b208-8067-4da3-be9d-f4a76f481ef7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:47.097230 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7de1b208-8067-4da3-be9d-f4a76f481ef7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:47.097686 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7de1b208-8067-4da3-be9d-f4a76f481ef7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:47.098455 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7de1b208-8067-4da3-be9d-f4a76f481ef7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:47.098914 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7de1b208-8067-4da3-be9d-f4a76f481ef7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:47.127851 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7de1b208-8067-4da3-be9d-f4a76f481ef7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042248 Jun 22 09:16:47.128423 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 574/1101] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:47 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:47.340540 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-cf36afb9-b963-45fa-ad7d-b5a213a5716e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:47.341137 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-cf36afb9-b963-45fa-ad7d-b5a213a5716e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:47.348262 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cf36afb9-b963-45fa-ad7d-b5a213a5716e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:47.355161 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cf36afb9-b963-45fa-ad7d-b5a213a5716e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:47.355161 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cf36afb9-b963-45fa-ad7d-b5a213a5716e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:47.355161 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cf36afb9-b963-45fa-ad7d-b5a213a5716e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:47.717543 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-cf36afb9-b963-45fa-ad7d-b5a213a5716e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:47.725463 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-cf36afb9-b963-45fa-ad7d-b5a213a5716e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.388872 Jun 22 09:16:47.726015 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 528/1102] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:47 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:48.139556 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-b84248d2-4bb8-4894-b823-c8ebffd48b2b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:48.140505 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-b84248d2-4bb8-4894-b823-c8ebffd48b2b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:48.147103 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b84248d2-4bb8-4894-b823-c8ebffd48b2b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:48.147547 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b84248d2-4bb8-4894-b823-c8ebffd48b2b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:48.148559 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b84248d2-4bb8-4894-b823-c8ebffd48b2b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:48.149020 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b84248d2-4bb8-4894-b823-c8ebffd48b2b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:48.177264 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-b84248d2-4bb8-4894-b823-c8ebffd48b2b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041647 Jun 22 09:16:48.177794 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 575/1103] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:48 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:48.741660 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a0f1021f-0415-4cd6-baf7-f3524653f8ce tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:48.742270 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a0f1021f-0415-4cd6-baf7-f3524653f8ce tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:48.744572 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=58 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:48.749290 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a0f1021f-0415-4cd6-baf7-f3524653f8ce tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:48.749790 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a0f1021f-0415-4cd6-baf7-f3524653f8ce tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:48.750548 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a0f1021f-0415-4cd6-baf7-f3524653f8ce tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:48.750981 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a0f1021f-0415-4cd6-baf7-f3524653f8ce tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:48.879156 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-a0f1021f-0415-4cd6-baf7-f3524653f8ce tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:48.887064 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a0f1021f-0415-4cd6-baf7-f3524653f8ce tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149232 Jun 22 09:16:48.887756 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 529/1104] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:48 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:49.189402 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c896a0bb-9213-4447-b15e-990b6c1e826c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:49.190366 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c896a0bb-9213-4447-b15e-990b6c1e826c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:49.196970 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c896a0bb-9213-4447-b15e-990b6c1e826c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:49.197423 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c896a0bb-9213-4447-b15e-990b6c1e826c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:49.198189 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c896a0bb-9213-4447-b15e-990b6c1e826c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:49.198627 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c896a0bb-9213-4447-b15e-990b6c1e826c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:49.228239 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c896a0bb-9213-4447-b15e-990b6c1e826c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043400 Jun 22 09:16:49.228808 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 576/1105] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:49 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:49.904558 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3bbcbfa7-5437-4094-9ebb-e799dce34383 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:49.905094 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3bbcbfa7-5437-4094-9ebb-e799dce34383 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:49.911917 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3bbcbfa7-5437-4094-9ebb-e799dce34383 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:49.912364 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3bbcbfa7-5437-4094-9ebb-e799dce34383 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:49.913145 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3bbcbfa7-5437-4094-9ebb-e799dce34383 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:49.913577 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3bbcbfa7-5437-4094-9ebb-e799dce34383 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:50.043652 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3bbcbfa7-5437-4094-9ebb-e799dce34383 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:50.052498 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3bbcbfa7-5437-4094-9ebb-e799dce34383 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.151849 Jun 22 09:16:50.053093 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 530/1106] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:49 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:50.239705 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-b97d6978-2b95-4134-a049-17e0b1a01f8f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:50.240628 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-b97d6978-2b95-4134-a049-17e0b1a01f8f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:50.247113 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b97d6978-2b95-4134-a049-17e0b1a01f8f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:50.247556 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b97d6978-2b95-4134-a049-17e0b1a01f8f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:50.248306 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b97d6978-2b95-4134-a049-17e0b1a01f8f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:50.248744 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b97d6978-2b95-4134-a049-17e0b1a01f8f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:50.277158 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-b97d6978-2b95-4134-a049-17e0b1a01f8f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041532 Jun 22 09:16:50.277691 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 577/1107] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:50 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:51.070186 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1a6afd46-9dbf-482e-bd4a-787e526ee38d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:51.070754 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1a6afd46-9dbf-482e-bd4a-787e526ee38d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:51.077257 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1a6afd46-9dbf-482e-bd4a-787e526ee38d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:51.077703 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1a6afd46-9dbf-482e-bd4a-787e526ee38d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:51.078463 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1a6afd46-9dbf-482e-bd4a-787e526ee38d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:51.078905 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1a6afd46-9dbf-482e-bd4a-787e526ee38d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:51.206597 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-1a6afd46-9dbf-482e-bd4a-787e526ee38d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:51.215405 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1a6afd46-9dbf-482e-bd4a-787e526ee38d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.148605 Jun 22 09:16:51.215562 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 531/1108] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:51 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:51.289066 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e59306c5-586d-4448-9cde-bde4f865cc38 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:51.289992 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e59306c5-586d-4448-9cde-bde4f865cc38 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:51.296117 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e59306c5-586d-4448-9cde-bde4f865cc38 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:51.296565 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e59306c5-586d-4448-9cde-bde4f865cc38 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:51.297358 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e59306c5-586d-4448-9cde-bde4f865cc38 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:51.297798 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e59306c5-586d-4448-9cde-bde4f865cc38 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:51.326390 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e59306c5-586d-4448-9cde-bde4f865cc38 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041216 Jun 22 09:16:51.326869 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 578/1109] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:51 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:52.231515 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-2414525e-1da4-4246-ba77-65b8abcbfb11 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:52.232131 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-2414525e-1da4-4246-ba77-65b8abcbfb11 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:52.238801 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2414525e-1da4-4246-ba77-65b8abcbfb11 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:52.239253 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2414525e-1da4-4246-ba77-65b8abcbfb11 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:52.240013 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2414525e-1da4-4246-ba77-65b8abcbfb11 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:52.240454 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2414525e-1da4-4246-ba77-65b8abcbfb11 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:52.337922 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-6d058720-ac1d-404c-9ff7-43ebf405faf9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:52.339114 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-6d058720-ac1d-404c-9ff7-43ebf405faf9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:52.346362 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6d058720-ac1d-404c-9ff7-43ebf405faf9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:52.346907 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6d058720-ac1d-404c-9ff7-43ebf405faf9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:52.347676 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6d058720-ac1d-404c-9ff7-43ebf405faf9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:52.348114 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6d058720-ac1d-404c-9ff7-43ebf405faf9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:52.368831 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-2414525e-1da4-4246-ba77-65b8abcbfb11 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:52.377813 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-2414525e-1da4-4246-ba77-65b8abcbfb11 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.150168 Jun 22 09:16:52.378764 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-6d058720-ac1d-404c-9ff7-43ebf405faf9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044764 Jun 22 09:16:52.382547 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 579/1110] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:52 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:52.382786 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 532/1111] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:52 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:53.389647 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-3ef3809b-2a45-4b6b-bbeb-f7502955aa86 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:53.390488 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-3ef3809b-2a45-4b6b-bbeb-f7502955aa86 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:53.395077 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-7b212481-22f0-4165-b9c3-7811ea734352 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:53.395690 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-7b212481-22f0-4165-b9c3-7811ea734352 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:53.397605 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3ef3809b-2a45-4b6b-bbeb-f7502955aa86 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:53.398326 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3ef3809b-2a45-4b6b-bbeb-f7502955aa86 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:53.399083 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3ef3809b-2a45-4b6b-bbeb-f7502955aa86 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:53.399518 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3ef3809b-2a45-4b6b-bbeb-f7502955aa86 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:53.403967 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7b212481-22f0-4165-b9c3-7811ea734352 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:53.404475 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7b212481-22f0-4165-b9c3-7811ea734352 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:53.405276 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7b212481-22f0-4165-b9c3-7811ea734352 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:53.405718 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7b212481-22f0-4165-b9c3-7811ea734352 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:53.429603 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-3ef3809b-2a45-4b6b-bbeb-f7502955aa86 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043966 Jun 22 09:16:53.430154 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 580/1112] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:53 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:53.535760 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-7b212481-22f0-4165-b9c3-7811ea734352 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:53.543819 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-7b212481-22f0-4165-b9c3-7811ea734352 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.153280 Jun 22 09:16:53.544377 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 533/1113] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:53 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:16:54.442074 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-63f6b8e7-08b0-4eb3-bb20-a3078da5e05f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:54.442920 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-63f6b8e7-08b0-4eb3-bb20-a3078da5e05f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:54.449449 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-63f6b8e7-08b0-4eb3-bb20-a3078da5e05f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:54.449897 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-63f6b8e7-08b0-4eb3-bb20-a3078da5e05f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:54.450646 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-63f6b8e7-08b0-4eb3-bb20-a3078da5e05f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:54.451079 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-63f6b8e7-08b0-4eb3-bb20-a3078da5e05f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:54.480292 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-63f6b8e7-08b0-4eb3-bb20-a3078da5e05f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042941 Jun 22 09:16:54.480869 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 581/1114] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:54 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:54.561227 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-301b867d-530e-4cd4-b471-f09123c897ae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:54.561838 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-301b867d-530e-4cd4-b471-f09123c897ae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:54.568827 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-301b867d-530e-4cd4-b471-f09123c897ae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:54.569281 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-301b867d-530e-4cd4-b471-f09123c897ae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:54.570044 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-301b867d-530e-4cd4-b471-f09123c897ae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:54.570479 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-301b867d-530e-4cd4-b471-f09123c897ae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:54.696655 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-301b867d-530e-4cd4-b471-f09123c897ae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:54.704584 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-301b867d-530e-4cd4-b471-f09123c897ae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.147174 Jun 22 09:16:54.705180 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 534/1115] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:54 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:55.492071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2a27157b-00d2-46f8-bbbc-ec27ad52f8ad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:55.493017 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2a27157b-00d2-46f8-bbbc-ec27ad52f8ad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:55.499448 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2a27157b-00d2-46f8-bbbc-ec27ad52f8ad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:55.499895 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2a27157b-00d2-46f8-bbbc-ec27ad52f8ad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:55.500652 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2a27157b-00d2-46f8-bbbc-ec27ad52f8ad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:55.501112 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2a27157b-00d2-46f8-bbbc-ec27ad52f8ad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:55.530726 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2a27157b-00d2-46f8-bbbc-ec27ad52f8ad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042629 Jun 22 09:16:55.531264 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 582/1116] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:55 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:55.722165 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-94cf34bc-1d33-4c0b-a76a-c8f5b4b57bac tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:55.722783 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-94cf34bc-1d33-4c0b-a76a-c8f5b4b57bac tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:55.729306 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-94cf34bc-1d33-4c0b-a76a-c8f5b4b57bac tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:55.729761 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-94cf34bc-1d33-4c0b-a76a-c8f5b4b57bac tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:55.730536 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-94cf34bc-1d33-4c0b-a76a-c8f5b4b57bac tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:55.731005 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-94cf34bc-1d33-4c0b-a76a-c8f5b4b57bac tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:55.733576 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=100 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:55.858853 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-94cf34bc-1d33-4c0b-a76a-c8f5b4b57bac tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:55.866903 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-94cf34bc-1d33-4c0b-a76a-c8f5b4b57bac tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149338 Jun 22 09:16:55.867476 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 535/1117] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:55 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:56.543252 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-812c8c61-0e0d-4d7d-9dce-332b077cc407 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:56.544210 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-812c8c61-0e0d-4d7d-9dce-332b077cc407 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:56.551372 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-812c8c61-0e0d-4d7d-9dce-332b077cc407 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:56.551823 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-812c8c61-0e0d-4d7d-9dce-332b077cc407 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:56.552580 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-812c8c61-0e0d-4d7d-9dce-332b077cc407 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:56.553049 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-812c8c61-0e0d-4d7d-9dce-332b077cc407 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:56.581806 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-812c8c61-0e0d-4d7d-9dce-332b077cc407 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042963 Jun 22 09:16:56.582357 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 583/1118] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:56 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:56.883676 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-44219af7-2044-47cd-9a42-fe2867a7aaa4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:56.884239 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-44219af7-2044-47cd-9a42-fe2867a7aaa4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:56.890789 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-44219af7-2044-47cd-9a42-fe2867a7aaa4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:56.891236 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-44219af7-2044-47cd-9a42-fe2867a7aaa4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:56.892098 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-44219af7-2044-47cd-9a42-fe2867a7aaa4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:56.892533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-44219af7-2044-47cd-9a42-fe2867a7aaa4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:57.023716 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-44219af7-2044-47cd-9a42-fe2867a7aaa4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:57.030875 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-44219af7-2044-47cd-9a42-fe2867a7aaa4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.151135 Jun 22 09:16:57.031427 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 536/1119] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:56 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:57.593228 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-b4bd5cd8-e460-4645-bbcc-c95c47bf85d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:57.594141 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-b4bd5cd8-e460-4645-bbcc-c95c47bf85d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:57.601508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b4bd5cd8-e460-4645-bbcc-c95c47bf85d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:57.601954 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b4bd5cd8-e460-4645-bbcc-c95c47bf85d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:57.603013 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b4bd5cd8-e460-4645-bbcc-c95c47bf85d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:57.603460 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b4bd5cd8-e460-4645-bbcc-c95c47bf85d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:57.632980 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-b4bd5cd8-e460-4645-bbcc-c95c47bf85d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043764 Jun 22 09:16:57.633521 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 584/1120] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:57 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:58.048702 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b44c83c0-466e-4681-875d-0944373dbef4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:58.049341 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-b44c83c0-466e-4681-875d-0944373dbef4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:58.055750 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b44c83c0-466e-4681-875d-0944373dbef4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:58.056201 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b44c83c0-466e-4681-875d-0944373dbef4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:58.056993 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b44c83c0-466e-4681-875d-0944373dbef4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:58.057432 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b44c83c0-466e-4681-875d-0944373dbef4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:58.191121 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-b44c83c0-466e-4681-875d-0944373dbef4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:58.199406 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-b44c83c0-466e-4681-875d-0944373dbef4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.154571 Jun 22 09:16:58.200026 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 537/1121] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:58 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:58.644282 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-cb641d3c-7c4b-49b5-a869-82432adddfcd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:58.645261 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-cb641d3c-7c4b-49b5-a869-82432adddfcd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:58.652097 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cb641d3c-7c4b-49b5-a869-82432adddfcd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:58.652549 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cb641d3c-7c4b-49b5-a869-82432adddfcd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:58.653410 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cb641d3c-7c4b-49b5-a869-82432adddfcd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:58.653853 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cb641d3c-7c4b-49b5-a869-82432adddfcd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:58.683089 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-cb641d3c-7c4b-49b5-a869-82432adddfcd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043496 Jun 22 09:16:58.683642 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 585/1122] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:58 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:59.215463 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f579e46d-5496-4a5e-b6d4-b4fcbdc2a117 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:59.216071 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f579e46d-5496-4a5e-b6d4-b4fcbdc2a117 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:59.222731 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f579e46d-5496-4a5e-b6d4-b4fcbdc2a117 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:59.223173 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f579e46d-5496-4a5e-b6d4-b4fcbdc2a117 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:59.223921 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f579e46d-5496-4a5e-b6d4-b4fcbdc2a117 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:59.224352 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f579e46d-5496-4a5e-b6d4-b4fcbdc2a117 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:59.363527 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-f579e46d-5496-4a5e-b6d4-b4fcbdc2a117 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:59.373285 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f579e46d-5496-4a5e-b6d4-b4fcbdc2a117 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.161431 Jun 22 09:16:59.374232 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 538/1123] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:59 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:59.694841 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-476d2280-d4dc-4f02-ad38-cfcbdb9a9e69 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:59.695692 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-476d2280-d4dc-4f02-ad38-cfcbdb9a9e69 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:59.702143 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-476d2280-d4dc-4f02-ad38-cfcbdb9a9e69 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:59.702592 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-476d2280-d4dc-4f02-ad38-cfcbdb9a9e69 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:59.703349 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-476d2280-d4dc-4f02-ad38-cfcbdb9a9e69 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:59.703851 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-476d2280-d4dc-4f02-ad38-cfcbdb9a9e69 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:59.732461 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-476d2280-d4dc-4f02-ad38-cfcbdb9a9e69 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041632 Jun 22 09:16:59.733034 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 586/1124] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:16:59 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:59.773236 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:16:59.773403 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Wed Jun 22 09:16:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:17:00.392456 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-99f8d13e-c784-4b6e-9898-bc6285de8d21 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:00.393092 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-99f8d13e-c784-4b6e-9898-bc6285de8d21 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:00.399884 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-99f8d13e-c784-4b6e-9898-bc6285de8d21 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:00.400893 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-99f8d13e-c784-4b6e-9898-bc6285de8d21 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:00.401226 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-99f8d13e-c784-4b6e-9898-bc6285de8d21 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:00.401528 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-99f8d13e-c784-4b6e-9898-bc6285de8d21 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:00.528230 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-99f8d13e-c784-4b6e-9898-bc6285de8d21 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:00.536178 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-99f8d13e-c784-4b6e-9898-bc6285de8d21 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.148272 Jun 22 09:17:00.536734 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 539/1125] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:00 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:00.744677 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-78789219-c69c-454b-beb5-d7adf18646bf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:00.745554 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-78789219-c69c-454b-beb5-d7adf18646bf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:00.752663 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-78789219-c69c-454b-beb5-d7adf18646bf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:00.753124 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-78789219-c69c-454b-beb5-d7adf18646bf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:00.753876 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-78789219-c69c-454b-beb5-d7adf18646bf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:00.754316 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-78789219-c69c-454b-beb5-d7adf18646bf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:00.783000 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-78789219-c69c-454b-beb5-d7adf18646bf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042458 Jun 22 09:17:00.783526 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 587/1126] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:00 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:01.553015 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-84f0dbc9-b17c-467c-9789-831ddd9d4757 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:01.553606 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-84f0dbc9-b17c-467c-9789-831ddd9d4757 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:01.560013 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-84f0dbc9-b17c-467c-9789-831ddd9d4757 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:01.560455 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-84f0dbc9-b17c-467c-9789-831ddd9d4757 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:01.561243 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-84f0dbc9-b17c-467c-9789-831ddd9d4757 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:01.561702 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-84f0dbc9-b17c-467c-9789-831ddd9d4757 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:01.691305 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-84f0dbc9-b17c-467c-9789-831ddd9d4757 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:01.699192 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-84f0dbc9-b17c-467c-9789-831ddd9d4757 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.150070 Jun 22 09:17:01.699948 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 540/1127] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:01 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:01.794041 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-db92176d-31d8-48b9-b6cf-7edc7ecaf49e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:01.794975 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-db92176d-31d8-48b9-b6cf-7edc7ecaf49e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:01.801465 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-db92176d-31d8-48b9-b6cf-7edc7ecaf49e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:01.801912 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-db92176d-31d8-48b9-b6cf-7edc7ecaf49e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:01.802665 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-db92176d-31d8-48b9-b6cf-7edc7ecaf49e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:01.803100 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-db92176d-31d8-48b9-b6cf-7edc7ecaf49e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:01.827584 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=100 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:01.832588 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-db92176d-31d8-48b9-b6cf-7edc7ecaf49e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042478 Jun 22 09:17:01.833160 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 588/1128] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:01 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:02.717775 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-80eb2d70-b2bc-4832-838f-61267820c026 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:02.718382 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-80eb2d70-b2bc-4832-838f-61267820c026 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:02.725458 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-80eb2d70-b2bc-4832-838f-61267820c026 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:02.725848 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-80eb2d70-b2bc-4832-838f-61267820c026 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:02.726602 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-80eb2d70-b2bc-4832-838f-61267820c026 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:02.727027 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-80eb2d70-b2bc-4832-838f-61267820c026 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:02.847895 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-3946e16c-186e-401b-8bc9-5280fdd7bbe3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:02.848845 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-3946e16c-186e-401b-8bc9-5280fdd7bbe3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:02.855875 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3946e16c-186e-401b-8bc9-5280fdd7bbe3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:02.856322 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3946e16c-186e-401b-8bc9-5280fdd7bbe3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:02.856627 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-80eb2d70-b2bc-4832-838f-61267820c026 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:02.857113 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3946e16c-186e-401b-8bc9-5280fdd7bbe3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:02.857545 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3946e16c-186e-401b-8bc9-5280fdd7bbe3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:02.865421 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-80eb2d70-b2bc-4832-838f-61267820c026 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.151499 Jun 22 09:17:02.865985 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 541/1129] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:02 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:02.886665 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-3946e16c-186e-401b-8bc9-5280fdd7bbe3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043433 Jun 22 09:17:02.887195 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 589/1130] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:02 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:17:03.882583 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-7a5833e5-5385-40ab-851d-4bde85941dae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:03.883194 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-7a5833e5-5385-40ab-851d-4bde85941dae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:03.889941 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7a5833e5-5385-40ab-851d-4bde85941dae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:03.890501 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7a5833e5-5385-40ab-851d-4bde85941dae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:03.891317 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7a5833e5-5385-40ab-851d-4bde85941dae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:03.891955 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7a5833e5-5385-40ab-851d-4bde85941dae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:03.898346 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2d3295d6-a0b0-467e-a70b-063e178b9e58 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:03.899275 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2d3295d6-a0b0-467e-a70b-063e178b9e58 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:03.905751 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2d3295d6-a0b0-467e-a70b-063e178b9e58 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:03.906203 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2d3295d6-a0b0-467e-a70b-063e178b9e58 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:03.906974 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2d3295d6-a0b0-467e-a70b-063e178b9e58 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:03.907571 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2d3295d6-a0b0-467e-a70b-063e178b9e58 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:03.936670 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2d3295d6-a0b0-467e-a70b-063e178b9e58 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042498 Jun 22 09:17:03.937296 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 590/1131] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:03 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:17:04.023962 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-7a5833e5-5385-40ab-851d-4bde85941dae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:04.032338 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-7a5833e5-5385-40ab-851d-4bde85941dae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.153181 Jun 22 09:17:04.032925 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 542/1132] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:03 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:04.949409 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-07904c93-a537-49b8-9452-b05517773c91 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:04.950264 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-07904c93-a537-49b8-9452-b05517773c91 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:04.956953 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-07904c93-a537-49b8-9452-b05517773c91 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:04.957440 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-07904c93-a537-49b8-9452-b05517773c91 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:04.958198 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-07904c93-a537-49b8-9452-b05517773c91 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:04.958637 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-07904c93-a537-49b8-9452-b05517773c91 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:04.988519 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-07904c93-a537-49b8-9452-b05517773c91 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043171 Jun 22 09:17:04.989281 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 591/1133] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:04 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:05.049821 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-4871086e-8694-454e-aaae-c19f7970b36d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:05.050427 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-4871086e-8694-454e-aaae-c19f7970b36d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:05.056826 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4871086e-8694-454e-aaae-c19f7970b36d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:05.057279 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4871086e-8694-454e-aaae-c19f7970b36d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:05.058032 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4871086e-8694-454e-aaae-c19f7970b36d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:05.058467 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4871086e-8694-454e-aaae-c19f7970b36d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:05.189194 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-4871086e-8694-454e-aaae-c19f7970b36d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:05.195835 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-4871086e-8694-454e-aaae-c19f7970b36d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.150397 Jun 22 09:17:05.196407 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 543/1134] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:05 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:05.999657 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-b2529d14-4f52-4b84-8ea7-9f0785178379 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:06.001248 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-b2529d14-4f52-4b84-8ea7-9f0785178379 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:06.008242 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b2529d14-4f52-4b84-8ea7-9f0785178379 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:06.008675 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b2529d14-4f52-4b84-8ea7-9f0785178379 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:06.009501 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b2529d14-4f52-4b84-8ea7-9f0785178379 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:06.009938 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b2529d14-4f52-4b84-8ea7-9f0785178379 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:06.038734 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-b2529d14-4f52-4b84-8ea7-9f0785178379 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043048 Jun 22 09:17:06.039268 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 592/1135] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:05 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:06.214134 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-aeba959e-c550-48ee-889d-941bf6f70262 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:06.214525 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-aeba959e-c550-48ee-889d-941bf6f70262 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:06.220687 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-aeba959e-c550-48ee-889d-941bf6f70262 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:06.221158 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-aeba959e-c550-48ee-889d-941bf6f70262 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:06.221912 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-aeba959e-c550-48ee-889d-941bf6f70262 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:06.222346 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-aeba959e-c550-48ee-889d-941bf6f70262 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:06.351164 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-aeba959e-c550-48ee-889d-941bf6f70262 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:06.359135 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-aeba959e-c550-48ee-889d-941bf6f70262 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149454 Jun 22 09:17:06.360327 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 544/1136] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:06 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:07.050320 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-aca312b9-66ad-4b60-baa3-ee486c8dfbb6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:07.051250 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-aca312b9-66ad-4b60-baa3-ee486c8dfbb6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:07.057589 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-aca312b9-66ad-4b60-baa3-ee486c8dfbb6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:07.058041 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-aca312b9-66ad-4b60-baa3-ee486c8dfbb6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:07.058810 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-aca312b9-66ad-4b60-baa3-ee486c8dfbb6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:07.059249 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-aca312b9-66ad-4b60-baa3-ee486c8dfbb6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:07.088762 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-aca312b9-66ad-4b60-baa3-ee486c8dfbb6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042486 Jun 22 09:17:07.089333 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 593/1137] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:07 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:07.377609 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-adf12eb1-e0e7-45ea-a933-7501cd40df35 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:07.378142 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-adf12eb1-e0e7-45ea-a933-7501cd40df35 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:07.384637 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-adf12eb1-e0e7-45ea-a933-7501cd40df35 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:07.385129 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-adf12eb1-e0e7-45ea-a933-7501cd40df35 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:07.385895 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-adf12eb1-e0e7-45ea-a933-7501cd40df35 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:07.386336 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-adf12eb1-e0e7-45ea-a933-7501cd40df35 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:07.520282 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-adf12eb1-e0e7-45ea-a933-7501cd40df35 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:07.528536 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-adf12eb1-e0e7-45ea-a933-7501cd40df35 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.155652 Jun 22 09:17:07.529121 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 545/1138] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:07 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:08.100869 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-b5e1f260-7528-4111-b12e-9ca5d7f21ee0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:08.101791 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-b5e1f260-7528-4111-b12e-9ca5d7f21ee0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:08.108171 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b5e1f260-7528-4111-b12e-9ca5d7f21ee0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:08.108619 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b5e1f260-7528-4111-b12e-9ca5d7f21ee0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:08.109402 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b5e1f260-7528-4111-b12e-9ca5d7f21ee0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:08.110401 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b5e1f260-7528-4111-b12e-9ca5d7f21ee0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:08.139669 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-b5e1f260-7528-4111-b12e-9ca5d7f21ee0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042820 Jun 22 09:17:08.140205 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 594/1139] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:08 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:08.545594 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-dbfb66a7-56e3-4745-9ef0-be2650e768f9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:08.546202 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-dbfb66a7-56e3-4745-9ef0-be2650e768f9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:08.552923 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dbfb66a7-56e3-4745-9ef0-be2650e768f9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:08.553370 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dbfb66a7-56e3-4745-9ef0-be2650e768f9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:08.554129 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dbfb66a7-56e3-4745-9ef0-be2650e768f9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:08.554561 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dbfb66a7-56e3-4745-9ef0-be2650e768f9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:08.688907 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-dbfb66a7-56e3-4745-9ef0-be2650e768f9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:08.696980 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-dbfb66a7-56e3-4745-9ef0-be2650e768f9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.155180 Jun 22 09:17:08.701472 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 546/1140] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:08 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:09.151606 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-adc9f90f-725d-4046-bf61-4df4c09dce80 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:09.152533 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-adc9f90f-725d-4046-bf61-4df4c09dce80 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:09.159831 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-adc9f90f-725d-4046-bf61-4df4c09dce80 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:09.160277 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-adc9f90f-725d-4046-bf61-4df4c09dce80 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:09.161072 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-adc9f90f-725d-4046-bf61-4df4c09dce80 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:09.161512 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-adc9f90f-725d-4046-bf61-4df4c09dce80 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:09.190069 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-adc9f90f-725d-4046-bf61-4df4c09dce80 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042665 Jun 22 09:17:09.190890 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 595/1141] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:09 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:09.714652 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-2c29f942-cc69-45e2-b163-ccd4f71d991a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:09.715273 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-2c29f942-cc69-45e2-b163-ccd4f71d991a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:09.722163 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2c29f942-cc69-45e2-b163-ccd4f71d991a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:09.722615 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2c29f942-cc69-45e2-b163-ccd4f71d991a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:09.723380 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2c29f942-cc69-45e2-b163-ccd4f71d991a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:09.723818 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2c29f942-cc69-45e2-b163-ccd4f71d991a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:09.855897 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-2c29f942-cc69-45e2-b163-ccd4f71d991a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:09.864349 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-2c29f942-cc69-45e2-b163-ccd4f71d991a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.153595 Jun 22 09:17:09.864922 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 547/1142] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:09 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:10.201975 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-bc01bec9-b75e-4cf6-8aaa-985a8768d699 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:10.202817 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-bc01bec9-b75e-4cf6-8aaa-985a8768d699 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:10.209393 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bc01bec9-b75e-4cf6-8aaa-985a8768d699 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:10.209843 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bc01bec9-b75e-4cf6-8aaa-985a8768d699 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:10.210606 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bc01bec9-b75e-4cf6-8aaa-985a8768d699 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:10.211041 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bc01bec9-b75e-4cf6-8aaa-985a8768d699 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:10.240303 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-bc01bec9-b75e-4cf6-8aaa-985a8768d699 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042369 Jun 22 09:17:10.240856 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 596/1143] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:10 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:10.882191 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-79a2e890-6641-46e1-af56-76c552cec2fb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:10.882816 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-79a2e890-6641-46e1-af56-76c552cec2fb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:10.889510 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-79a2e890-6641-46e1-af56-76c552cec2fb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:10.889971 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-79a2e890-6641-46e1-af56-76c552cec2fb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:10.890773 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-79a2e890-6641-46e1-af56-76c552cec2fb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:10.891948 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-79a2e890-6641-46e1-af56-76c552cec2fb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:11.018242 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-79a2e890-6641-46e1-af56-76c552cec2fb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:11.026538 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-79a2e890-6641-46e1-af56-76c552cec2fb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.148575 Jun 22 09:17:11.027110 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 548/1144] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:10 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:11.252582 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-ad2d7d27-27ea-4a8e-bb5b-206e1adffdd7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:11.253557 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-ad2d7d27-27ea-4a8e-bb5b-206e1adffdd7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:11.260128 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ad2d7d27-27ea-4a8e-bb5b-206e1adffdd7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:11.260579 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ad2d7d27-27ea-4a8e-bb5b-206e1adffdd7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:11.261372 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ad2d7d27-27ea-4a8e-bb5b-206e1adffdd7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:11.261812 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ad2d7d27-27ea-4a8e-bb5b-206e1adffdd7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:11.290800 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-ad2d7d27-27ea-4a8e-bb5b-206e1adffdd7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042870 Jun 22 09:17:11.291384 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 597/1145] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:11 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:11.705657 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f792abac-3df0-4f36-a4db-f12bf33db409 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:11.706153 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f792abac-3df0-4f36-a4db-f12bf33db409 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: f5dbd1b0-e21e-46fd-818b-da300c8cf1e7] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:11.712185 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f792abac-3df0-4f36-a4db-f12bf33db409 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:11.712633 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f792abac-3df0-4f36-a4db-f12bf33db409 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:11.713428 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f792abac-3df0-4f36-a4db-f12bf33db409 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:11.713858 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f792abac-3df0-4f36-a4db-f12bf33db409 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:11.738708 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f792abac-3df0-4f36-a4db-f12bf33db409 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: f5dbd1b0-e21e-46fd-818b-da300c8cf1e7] Going to try to terminate instance {{(pid=118024) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:17:12.008271 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f792abac-3df0-4f36-a4db-f12bf33db409 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7" status: 204 len: 0 microversion: 2.1 time: 0.306994 Jun 22 09:17:12.008894 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 549/1146] 10.222.0.16 () {58 vars in 1238 bytes} [Wed Jun 22 09:17:11 2022] DELETE /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:17:12.017143 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-db133d8e-39b9-48ca-9b32-b082d1212422 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:12.017766 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-db133d8e-39b9-48ca-9b32-b082d1212422 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: f5dbd1b0-e21e-46fd-818b-da300c8cf1e7] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:12.019750 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=58 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:12.024945 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-db133d8e-39b9-48ca-9b32-b082d1212422 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:12.025390 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-db133d8e-39b9-48ca-9b32-b082d1212422 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:12.026144 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-db133d8e-39b9-48ca-9b32-b082d1212422 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:12.026579 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-db133d8e-39b9-48ca-9b32-b082d1212422 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:12.044146 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-89ec9466-c328-4fde-a361-a3b03efc81d9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:12.044879 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-89ec9466-c328-4fde-a361-a3b03efc81d9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:12.051804 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-89ec9466-c328-4fde-a361-a3b03efc81d9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:12.052373 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-89ec9466-c328-4fde-a361-a3b03efc81d9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:12.053178 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-89ec9466-c328-4fde-a361-a3b03efc81d9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:12.053641 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-89ec9466-c328-4fde-a361-a3b03efc81d9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:12.058078 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:12.217355 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-db133d8e-39b9-48ca-9b32-b082d1212422 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:12.229653 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-db133d8e-39b9-48ca-9b32-b082d1212422 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7" status: 200 len: 1679 microversion: 2.1 time: 0.216107 Jun 22 09:17:12.231089 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 598/1147] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:12 2022] GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 => generated 1679 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:12.246560 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-89ec9466-c328-4fde-a361-a3b03efc81d9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:12.255859 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-89ec9466-c328-4fde-a361-a3b03efc81d9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.216056 Jun 22 09:17:12.256425 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 550/1148] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:12 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:17:12.302803 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-1f8b5dd1-c395-4022-b135-fd4c573fe7d5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:12.303759 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-1f8b5dd1-c395-4022-b135-fd4c573fe7d5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:12.310169 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1f8b5dd1-c395-4022-b135-fd4c573fe7d5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:12.310612 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1f8b5dd1-c395-4022-b135-fd4c573fe7d5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:12.311359 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1f8b5dd1-c395-4022-b135-fd4c573fe7d5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:12.311788 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1f8b5dd1-c395-4022-b135-fd4c573fe7d5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:12.341505 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-1f8b5dd1-c395-4022-b135-fd4c573fe7d5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042642 Jun 22 09:17:12.342032 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 599/1149] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:12 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:13.249307 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-41a5f486-7c71-4be0-816e-dcda66668b68 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:13.249969 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-41a5f486-7c71-4be0-816e-dcda66668b68 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: f5dbd1b0-e21e-46fd-818b-da300c8cf1e7] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:13.257468 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-41a5f486-7c71-4be0-816e-dcda66668b68 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:13.257918 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-41a5f486-7c71-4be0-816e-dcda66668b68 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:13.259135 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-41a5f486-7c71-4be0-816e-dcda66668b68 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:13.259575 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-41a5f486-7c71-4be0-816e-dcda66668b68 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:13.273984 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-4190d903-761b-4056-a5b6-ed7053fbbc5e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:13.276001 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-4190d903-761b-4056-a5b6-ed7053fbbc5e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:13.283685 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4190d903-761b-4056-a5b6-ed7053fbbc5e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:13.284133 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4190d903-761b-4056-a5b6-ed7053fbbc5e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:13.284922 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4190d903-761b-4056-a5b6-ed7053fbbc5e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:13.285356 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4190d903-761b-4056-a5b6-ed7053fbbc5e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:13.330393 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-41a5f486-7c71-4be0-816e-dcda66668b68 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:13.355356 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-41a5f486-7c71-4be0-816e-dcda66668b68 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7" status: 200 len: 1613 microversion: 2.1 time: 0.109854 Jun 22 09:17:13.356325 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 551/1150] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:13 2022] GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 => generated 1613 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:13.362661 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-7266addc-033e-4fc3-9a40-ef9660dba61a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:13.363988 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-7266addc-033e-4fc3-9a40-ef9660dba61a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:13.370271 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7266addc-033e-4fc3-9a40-ef9660dba61a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:13.371170 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7266addc-033e-4fc3-9a40-ef9660dba61a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:13.372010 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7266addc-033e-4fc3-9a40-ef9660dba61a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:13.372533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7266addc-033e-4fc3-9a40-ef9660dba61a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:13.407458 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-7266addc-033e-4fc3-9a40-ef9660dba61a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049243 Jun 22 09:17:13.408575 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 552/1151] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:13 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:13.435648 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-4190d903-761b-4056-a5b6-ed7053fbbc5e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:13.443826 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-4190d903-761b-4056-a5b6-ed7053fbbc5e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.174451 Jun 22 09:17:13.444390 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 600/1152] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:13 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:17:13.686713 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [req-66e42e91-1c42-43a4-afcc-e88351786a5f req-9cf6e9fe-a08d-4e84-822d-c8f963b0e6f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5dbd1b0-e21e-46fd-818b-da300c8cf1e7", "name": "network-vif-deleted", "tag": "edb7b6e6-c1cd-48e0-a71d-abbc95680749"}]} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:17:13.696673 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-66e42e91-1c42-43a4-afcc-e88351786a5f req-9cf6e9fe-a08d-4e84-822d-c8f963b0e6f6 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:13.697567 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-66e42e91-1c42-43a4-afcc-e88351786a5f req-9cf6e9fe-a08d-4e84-822d-c8f963b0e6f6 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:13.710810 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.compute.server_external_events [req-66e42e91-1c42-43a4-afcc-e88351786a5f req-9cf6e9fe-a08d-4e84-822d-c8f963b0e6f6 service nova] Creating event network-vif-deleted:edb7b6e6-c1cd-48e0-a71d-abbc95680749 for instance f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 on hv-cinder-84599 Jun 22 09:17:13.716271 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [req-66e42e91-1c42-43a4-afcc-e88351786a5f req-9cf6e9fe-a08d-4e84-822d-c8f963b0e6f6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096570 Jun 22 09:17:13.717245 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 553/1153] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:14.372814 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a8c3489c-0daa-4b14-bfb9-1f3c86963019 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:14.373579 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-a8c3489c-0daa-4b14-bfb9-1f3c86963019 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: f5dbd1b0-e21e-46fd-818b-da300c8cf1e7] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:14.380465 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a8c3489c-0daa-4b14-bfb9-1f3c86963019 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:14.380968 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a8c3489c-0daa-4b14-bfb9-1f3c86963019 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:14.381745 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a8c3489c-0daa-4b14-bfb9-1f3c86963019 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:14.382188 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a8c3489c-0daa-4b14-bfb9-1f3c86963019 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:14.420432 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-8dfb9d2e-c714-4310-abf5-3e48757c7b51 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:14.422134 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-8dfb9d2e-c714-4310-abf5-3e48757c7b51 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:14.426445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a8c3489c-0daa-4b14-bfb9-1f3c86963019 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:14.427175 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a8c3489c-0daa-4b14-bfb9-1f3c86963019 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:14.427906 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.objects.instance [None req-a8c3489c-0daa-4b14-bfb9-1f3c86963019 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lazy-loading 'fault' on Instance uuid f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 {{(pid=118025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:17:14.444791 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8dfb9d2e-c714-4310-abf5-3e48757c7b51 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:14.444791 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8dfb9d2e-c714-4310-abf5-3e48757c7b51 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:14.445287 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8dfb9d2e-c714-4310-abf5-3e48757c7b51 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:14.445725 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8dfb9d2e-c714-4310-abf5-3e48757c7b51 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:14.478480 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-a8c3489c-0daa-4b14-bfb9-1f3c86963019 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:14.486646 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a8c3489c-0daa-4b14-bfb9-1f3c86963019 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7" status: 200 len: 1330 microversion: 2.1 time: 0.117630 Jun 22 09:17:14.487217 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 601/1154] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:14 2022] GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 => generated 1330 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:14.488683 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-8dfb9d2e-c714-4310-abf5-3e48757c7b51 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072864 Jun 22 09:17:14.489305 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 554/1155] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:14 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:14.491634 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-3a711a01-5b55-4a77-841e-2c7f4567a2ec tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:14.492254 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-3a711a01-5b55-4a77-841e-2c7f4567a2ec tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:14.502547 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3a711a01-5b55-4a77-841e-2c7f4567a2ec tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:14.502993 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3a711a01-5b55-4a77-841e-2c7f4567a2ec tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:14.503954 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3a711a01-5b55-4a77-841e-2c7f4567a2ec tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:14.504582 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3a711a01-5b55-4a77-841e-2c7f4567a2ec tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:14.653208 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-3a711a01-5b55-4a77-841e-2c7f4567a2ec tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:14.662158 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-3a711a01-5b55-4a77-841e-2c7f4567a2ec tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.173812 Jun 22 09:17:14.662737 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 602/1156] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:14 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:15.499665 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3056aa11-a08b-44f9-9668-c615e2accb26 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:15.501100 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3056aa11-a08b-44f9-9668-c615e2accb26 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:15.507569 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3056aa11-a08b-44f9-9668-c615e2accb26 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:15.508016 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3056aa11-a08b-44f9-9668-c615e2accb26 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:15.508773 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3056aa11-a08b-44f9-9668-c615e2accb26 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:15.509230 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3056aa11-a08b-44f9-9668-c615e2accb26 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:15.509666 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a12c08b0-44d0-4986-8a80-7ac5ac9c7a3d tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:15.510290 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-a12c08b0-44d0-4986-8a80-7ac5ac9c7a3d tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: f5dbd1b0-e21e-46fd-818b-da300c8cf1e7] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:15.517472 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a12c08b0-44d0-4986-8a80-7ac5ac9c7a3d tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:15.517923 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a12c08b0-44d0-4986-8a80-7ac5ac9c7a3d tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:15.518691 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a12c08b0-44d0-4986-8a80-7ac5ac9c7a3d tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:15.519128 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a12c08b0-44d0-4986-8a80-7ac5ac9c7a3d tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:15.532876 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.wsgi [None req-a12c08b0-44d0-4986-8a80-7ac5ac9c7a3d tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] HTTP exception thrown: Instance f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 could not be found. Jun 22 09:17:15.534405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a12c08b0-44d0-4986-8a80-7ac5ac9c7a3d tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Request method failure captured: Jun 22 09:17:15.534405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: request: GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 HTTP/1.1 Jun 22 09:17:15.534405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept: application/json Jun 22 09:17:15.534405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept-Encoding: identity Jun 22 09:17:15.534405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Connection: close Jun 22 09:17:15.534405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Length: 0 Jun 22 09:17:15.534405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Type: application/json Jun 22 09:17:15.534405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Host: 10.222.0.16 Jun 22 09:17:15.534405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Openstack-System-Scope: None Jun 22 09:17:15.534405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: User-Agent: python-urllib3/1.26.9 Jun 22 09:17:15.534405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Auth-Token: gAAAAABistmqD47tOpCEfZxXQ7v8d4kDBzbZcFIWDuyhnuGnU13mxMlhbgt18xo2M0HJq-gXeYBWo0pfkDLuGB3yaG8TUwjVHhSVzhHn4vsUiwL4uQjCeCtk_V7_A6rYsksudlP-79icDu6EqbcTRNIwpnAGEp7HhBlOtNGTaFEH_UUlynGlRmI Jun 22 09:17:15.534405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Id: None Jun 22 09:17:15.534405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Name: None Jun 22 09:17:15.534405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Identity-Status: Confirmed Jun 22 09:17:15.534405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Is-Admin-Project: True Jun 22 09:17:15.534405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Id: default Jun 22 09:17:15.534405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Name: Default Jun 22 09:17:15.534405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Id: 9ebdcb9809a84f25bd578f8aca09802c Jun 22 09:17:15.534405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Name: tempest-AttachVolumeNegativeTest-914919780 Jun 22 09:17:15.534405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Role: member,reader Jun 22 09:17:15.534405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Roles: member,reader Jun 22 09:17:15.536024 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebdcb9809a84f25bd578f8aca09802c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebdcb9809a84f25bd578f8aca09802c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ebdcb9809a84f25bd578f8aca09802c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ebdcb9809a84f25bd578f8aca09802c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:17:15.536024 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant: tempest-AttachVolumeNegativeTest-914919780 Jun 22 09:17:15.536024 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Id: 9ebdcb9809a84f25bd578f8aca09802c Jun 22 09:17:15.536024 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-914919780 Jun 22 09:17:15.536024 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User: tempest-AttachVolumeNegativeTest-914919780-project Jun 22 09:17:15.536024 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Id: default Jun 22 09:17:15.536024 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Name: Default Jun 22 09:17:15.536024 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Id: 71ea2610ccc044de9d66444b4038fe9e Jun 22 09:17:15.536024 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Name: tempest-AttachVolumeNegativeTest-914919780-project Jun 22 09:17:15.536024 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: method: > Jun 22 09:17:15.536024 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: exception: Instance f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 could not be found. Jun 22 09:17:15.536024 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: action_args: {'id': 'f5dbd1b0-e21e-46fd-818b-da300c8cf1e7'} Jun 22 09:17:15.537039 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:17:15.537039 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:17:15.537039 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:17:15.537039 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:17:15.537039 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:17:15.537039 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:17:15.537039 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:17:15.537039 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:17:15.537039 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:17:15.537039 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:17:15.537039 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 could not be found. Jun 22 09:17:15.537039 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:17:15.537039 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:17:15.537039 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:17:15.537039 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:17:15.537039 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:17:15.537039 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:17:15.537039 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:17:15.537039 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:17:15.537039 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:17:15.538759 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:17:15.538759 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:17:15.538759 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:17:15.538759 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:17:15.538759 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:17:15.538759 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:17:15.538759 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:17:15.538759 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 could not be found. Jun 22 09:17:15.538759 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:17:15.538759 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:17:15.538759 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:17:15.538759 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:17:15.538759 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:17:15.538759 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:17:15.538759 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:17:15.538759 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:17:15.538759 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 could not be found. Jun 22 09:17:15.538759 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:17:15.540216 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a12c08b0-44d0-4986-8a80-7ac5ac9c7a3d tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Returning 404 to user: Instance f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 could not be found. {{(pid=118025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:17:15.540216 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a12c08b0-44d0-4986-8a80-7ac5ac9c7a3d tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7" status: 404 len: 111 microversion: 2.1 time: 0.030077 Jun 22 09:17:15.540216 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 603/1157] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:15 2022] GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 09:17:15.540515 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3056aa11-a08b-44f9-9668-c615e2accb26 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044005 Jun 22 09:17:15.540515 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 555/1158] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:15 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:15.548652 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d5e4d9fb-1928-476e-a7bd-ccb675b5e3a3 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '.version_select at 0x7f5756143280>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:15.644269 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d5e4d9fb-1928-476e-a7bd-ccb675b5e3a3 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-111095477" status: 202 len: 0 microversion: 2.1 time: 0.099044 Jun 22 09:17:15.645034 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 604/1159] 10.222.0.16 () {58 vars in 1217 bytes} [Wed Jun 22 09:17:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-111095477 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:17:15.679428 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f5838341-162a-4191-bc87-bf96ddd6f73a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:15.680048 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f5838341-162a-4191-bc87-bf96ddd6f73a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:15.686164 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f5838341-162a-4191-bc87-bf96ddd6f73a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:15.686616 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f5838341-162a-4191-bc87-bf96ddd6f73a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:15.687376 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f5838341-162a-4191-bc87-bf96ddd6f73a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:15.688596 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f5838341-162a-4191-bc87-bf96ddd6f73a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:15.855378 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-f5838341-162a-4191-bc87-bf96ddd6f73a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:15.863961 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f5838341-162a-4191-bc87-bf96ddd6f73a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.188446 Jun 22 09:17:15.864516 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 556/1160] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:15 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:16.523691 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-6b9ace22-7bb2-4666-8d39-849e3adacfb3 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Action: 'create', calling method: .version_select at 0x7f5756276940>, body: {"keypair": {"name": "tempest-keypair-927026018", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFC9nBNUFRziZH/ZidQDsxvBqlJnXdyUXgKJfobVHWgCzzn9p8RkMQe7Fz+wx5b/jqHrmR0PcAzZqgm3VVpdM9MN7HI7WwDh+NXpnMm5lAQVL+mTpOUwMUHuKtc1hOL3QQ=="}} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:17:16.539865 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.quota [None req-6b9ace22-7bb2-4666-8d39-849e3adacfb3 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Getting quotas for project 9ebdcb9809a84f25bd578f8aca09802c. Resources: {'key_pairs'} {{(pid=118025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:17:16.543702 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.quota [None req-6b9ace22-7bb2-4666-8d39-849e3adacfb3 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Getting quotas for user 71ea2610ccc044de9d66444b4038fe9e and project 9ebdcb9809a84f25bd578f8aca09802c. Resources: {'key_pairs'} {{(pid=118025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:17:16.551064 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ee638181-9bb9-47f7-ad60-112ad0a887c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:16.552042 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ee638181-9bb9-47f7-ad60-112ad0a887c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:16.558479 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ee638181-9bb9-47f7-ad60-112ad0a887c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:16.558928 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ee638181-9bb9-47f7-ad60-112ad0a887c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:16.559686 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ee638181-9bb9-47f7-ad60-112ad0a887c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:16.560298 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ee638181-9bb9-47f7-ad60-112ad0a887c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:16.589003 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ee638181-9bb9-47f7-ad60-112ad0a887c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041757 Jun 22 09:17:16.589551 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 557/1161] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:16 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:17:16.632585 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-6b9ace22-7bb2-4666-8d39-849e3adacfb3 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.112933 Jun 22 09:17:16.633156 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 605/1162] 10.222.0.16 () {60 vars in 1158 bytes} [Wed Jun 22 09:17:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:16.883016 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-d25d53df-029e-4fd4-b08a-e07253e9dc85 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:16.883574 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-d25d53df-029e-4fd4-b08a-e07253e9dc85 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:16.889586 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d25d53df-029e-4fd4-b08a-e07253e9dc85 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:16.890031 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d25d53df-029e-4fd4-b08a-e07253e9dc85 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:16.891482 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d25d53df-029e-4fd4-b08a-e07253e9dc85 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:16.892291 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d25d53df-029e-4fd4-b08a-e07253e9dc85 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:17.035111 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-d25d53df-029e-4fd4-b08a-e07253e9dc85 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:17.035111 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-d25d53df-029e-4fd4-b08a-e07253e9dc85 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.156798 Jun 22 09:17:17.035340 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 558/1163] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:16 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:17.600159 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-86620555-d137-4941-b64b-55d4be9139f9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:17.601139 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-86620555-d137-4941-b64b-55d4be9139f9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:17.607590 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-86620555-d137-4941-b64b-55d4be9139f9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:17.608039 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-86620555-d137-4941-b64b-55d4be9139f9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:17.608822 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-86620555-d137-4941-b64b-55d4be9139f9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:17.609264 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-86620555-d137-4941-b64b-55d4be9139f9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:17.638972 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-86620555-d137-4941-b64b-55d4be9139f9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042800 Jun 22 09:17:17.639514 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 606/1164] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:17 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:18.051945 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-7c62ec2a-8456-4912-96ce-967ce822de90 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:18.052878 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-7c62ec2a-8456-4912-96ce-967ce822de90 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:18.060064 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7c62ec2a-8456-4912-96ce-967ce822de90 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:18.060617 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7c62ec2a-8456-4912-96ce-967ce822de90 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:18.061509 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7c62ec2a-8456-4912-96ce-967ce822de90 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:18.062039 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7c62ec2a-8456-4912-96ce-967ce822de90 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:18.196832 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-7c62ec2a-8456-4912-96ce-967ce822de90 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:18.204989 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-7c62ec2a-8456-4912-96ce-967ce822de90 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.157044 Jun 22 09:17:18.209763 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 559/1165] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:18 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:18.651010 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-dcb23f2d-4d0c-4880-a634-67d1515c0344 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:18.652017 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-dcb23f2d-4d0c-4880-a634-67d1515c0344 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:18.659527 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dcb23f2d-4d0c-4880-a634-67d1515c0344 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:18.659980 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dcb23f2d-4d0c-4880-a634-67d1515c0344 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:18.660753 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dcb23f2d-4d0c-4880-a634-67d1515c0344 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:18.661220 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dcb23f2d-4d0c-4880-a634-67d1515c0344 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:18.685764 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=100 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:18.690479 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-dcb23f2d-4d0c-4880-a634-67d1515c0344 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043811 Jun 22 09:17:18.691033 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 607/1166] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:18 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:18.806165 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-56862a22-3a03-4904-a084-6dffd8898684 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-180812073", "imageRef": "c24d36a8-7909-4174-9b12-42c8d76647ac", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "32fd7d44-45b4-465a-a792-69017447bde6"}], "security_groups": [{"name": "tempest-securitygroup--613731492"}], "key_name": "tempest-keypair-927026018", "user_data": "}} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:17:18.812727 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:18.907090 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.network.neutron [None req-56862a22-3a03-4904-a084-6dffd8898684 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] validate_networks() for [('32fd7d44-45b4-465a-a792-69017447bde6', None, None, None, None, None)] {{(pid=118024) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:17:19.222793 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-1d3e11ed-0809-4344-a622-4776741e26f4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:19.223488 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-1d3e11ed-0809-4344-a622-4776741e26f4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:19.229977 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1d3e11ed-0809-4344-a622-4776741e26f4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:19.230480 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1d3e11ed-0809-4344-a622-4776741e26f4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:19.231230 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1d3e11ed-0809-4344-a622-4776741e26f4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:19.231665 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1d3e11ed-0809-4344-a622-4776741e26f4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:19.355441 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-56862a22-3a03-4904-a084-6dffd8898684 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Flavor limits 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:17:19.355928 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-56862a22-3a03-4904-a084-6dffd8898684 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Image limits 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:17:19.356392 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-56862a22-3a03-4904-a084-6dffd8898684 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Flavor pref 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:17:19.356813 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-56862a22-3a03-4904-a084-6dffd8898684 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Image pref 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:17:19.357248 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-56862a22-3a03-4904-a084-6dffd8898684 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:17:19.366095 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-56862a22-3a03-4904-a084-6dffd8898684 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:19.366541 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-56862a22-3a03-4904-a084-6dffd8898684 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:19.367326 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-56862a22-3a03-4904-a084-6dffd8898684 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:19.367760 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-56862a22-3a03-4904-a084-6dffd8898684 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:19.384745 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.quota [None req-56862a22-3a03-4904-a084-6dffd8898684 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Getting quotas for project 9ebdcb9809a84f25bd578f8aca09802c. Resources: {'cores', 'instances', 'ram'} {{(pid=118024) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:17:19.388689 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.quota [None req-56862a22-3a03-4904-a084-6dffd8898684 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Getting quotas for user 71ea2610ccc044de9d66444b4038fe9e and project 9ebdcb9809a84f25bd578f8aca09802c. Resources: {'cores', 'instances', 'ram'} {{(pid=118024) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:17:19.400544 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-1d3e11ed-0809-4344-a622-4776741e26f4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:19.400717 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-56862a22-3a03-4904-a084-6dffd8898684 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Going to run 1 instances... {{(pid=118024) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:17:19.402983 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-56862a22-3a03-4904-a084-6dffd8898684 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: 46fa6d8c-afd7-4385-a727-ee8d14223669] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c24d36a8-7909-4174-9b12-42c8d76647ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118024) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:17:19.408825 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-1d3e11ed-0809-4344-a622-4776741e26f4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.190542 Jun 22 09:17:19.409382 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 608/1167] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:19 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:17:19.526199 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-56862a22-3a03-4904-a084-6dffd8898684 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.724181 Jun 22 09:17:19.526950 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 560/1168] 10.222.0.16 () {60 vars in 1146 bytes} [Wed Jun 22 09:17:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:17:19.537195 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c636dd94-d5a2-49fb-896c-cd321b5458d6 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:19.537814 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c636dd94-d5a2-49fb-896c-cd321b5458d6 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: 46fa6d8c-afd7-4385-a727-ee8d14223669] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:19.592045 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c636dd94-d5a2-49fb-896c-cd321b5458d6 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:19.599372 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c636dd94-d5a2-49fb-896c-cd321b5458d6 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669" status: 200 len: 1240 microversion: 2.1 time: 0.066003 Jun 22 09:17:19.599936 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 609/1169] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:19 2022] GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669 => generated 1240 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:19.701537 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-4f571585-ef86-4781-8032-a2dd929af1e7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:19.702557 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-4f571585-ef86-4781-8032-a2dd929af1e7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:19.709308 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4f571585-ef86-4781-8032-a2dd929af1e7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:19.709757 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4f571585-ef86-4781-8032-a2dd929af1e7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:19.710603 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4f571585-ef86-4781-8032-a2dd929af1e7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:19.710952 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4f571585-ef86-4781-8032-a2dd929af1e7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:19.741361 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-4f571585-ef86-4781-8032-a2dd929af1e7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043836 Jun 22 09:17:19.741914 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 561/1170] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:19 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:20.424992 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-13b3c37d-2d18-4b17-bb05-4d84aab6b350 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:20.431931 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-13b3c37d-2d18-4b17-bb05-4d84aab6b350 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:20.432645 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-13b3c37d-2d18-4b17-bb05-4d84aab6b350 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:20.433124 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-13b3c37d-2d18-4b17-bb05-4d84aab6b350 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:20.433943 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-13b3c37d-2d18-4b17-bb05-4d84aab6b350 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:20.434318 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-13b3c37d-2d18-4b17-bb05-4d84aab6b350 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:20.564441 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-13b3c37d-2d18-4b17-bb05-4d84aab6b350 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:20.572513 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-13b3c37d-2d18-4b17-bb05-4d84aab6b350 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.151416 Jun 22 09:17:20.573100 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 610/1171] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:20 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:20.615959 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-371bedb7-d3fa-43de-a06a-2688a563b9bd tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:20.616564 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-371bedb7-d3fa-43de-a06a-2688a563b9bd tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: 46fa6d8c-afd7-4385-a727-ee8d14223669] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:20.622774 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-371bedb7-d3fa-43de-a06a-2688a563b9bd tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:20.623259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-371bedb7-d3fa-43de-a06a-2688a563b9bd tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:20.624023 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-371bedb7-d3fa-43de-a06a-2688a563b9bd tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:20.624451 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-371bedb7-d3fa-43de-a06a-2688a563b9bd tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:20.688796 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-371bedb7-d3fa-43de-a06a-2688a563b9bd tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:20.696630 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-371bedb7-d3fa-43de-a06a-2688a563b9bd tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669" status: 200 len: 1244 microversion: 2.1 time: 0.084801 Jun 22 09:17:20.697259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 562/1172] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:20 2022] GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:20.752789 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-0047943d-f197-4605-9f8c-965abbd970d5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:20.753840 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-0047943d-f197-4605-9f8c-965abbd970d5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:20.760177 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0047943d-f197-4605-9f8c-965abbd970d5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:20.760733 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0047943d-f197-4605-9f8c-965abbd970d5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:20.761768 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0047943d-f197-4605-9f8c-965abbd970d5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:20.762222 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0047943d-f197-4605-9f8c-965abbd970d5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:20.792685 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-0047943d-f197-4605-9f8c-965abbd970d5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044117 Jun 22 09:17:20.793261 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 611/1173] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:20 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:21.590427 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1d3d9187-0998-483f-8851-b28112fe5d61 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:21.591270 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1d3d9187-0998-483f-8851-b28112fe5d61 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:21.600337 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1d3d9187-0998-483f-8851-b28112fe5d61 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:21.600851 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1d3d9187-0998-483f-8851-b28112fe5d61 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:21.601588 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1d3d9187-0998-483f-8851-b28112fe5d61 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:21.602227 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1d3d9187-0998-483f-8851-b28112fe5d61 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:21.714372 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-4bba1b0c-79eb-49b7-87fc-d93f4cae45cb tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:21.715808 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-4bba1b0c-79eb-49b7-87fc-d93f4cae45cb tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: 46fa6d8c-afd7-4385-a727-ee8d14223669] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:21.725811 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4bba1b0c-79eb-49b7-87fc-d93f4cae45cb tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:21.727190 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4bba1b0c-79eb-49b7-87fc-d93f4cae45cb tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:21.728159 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4bba1b0c-79eb-49b7-87fc-d93f4cae45cb tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:21.729508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4bba1b0c-79eb-49b7-87fc-d93f4cae45cb tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:21.760240 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-1d3d9187-0998-483f-8851-b28112fe5d61 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:21.768589 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1d3d9187-0998-483f-8851-b28112fe5d61 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.182121 Jun 22 09:17:21.769186 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 563/1174] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:21 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:21.795484 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-4bba1b0c-79eb-49b7-87fc-d93f4cae45cb tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:21.803610 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-4bba1b0c-79eb-49b7-87fc-d93f4cae45cb tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669" status: 200 len: 1310 microversion: 2.1 time: 0.093835 Jun 22 09:17:21.804172 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 612/1175] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:21 2022] GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669 => generated 1310 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:17:21.804407 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-22129568-508e-45ce-a064-e115eac90332 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:21.805445 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-22129568-508e-45ce-a064-e115eac90332 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:21.811425 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-22129568-508e-45ce-a064-e115eac90332 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:21.811874 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-22129568-508e-45ce-a064-e115eac90332 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:21.813357 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-22129568-508e-45ce-a064-e115eac90332 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:21.818795 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-22129568-508e-45ce-a064-e115eac90332 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:21.842019 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-22129568-508e-45ce-a064-e115eac90332 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041479 Jun 22 09:17:21.843382 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 564/1176] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:21 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:17:22.786891 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a8a63304-d4c5-4669-b603-f0bdc53d72ae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:22.787515 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-a8a63304-d4c5-4669-b603-f0bdc53d72ae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:22.794160 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a8a63304-d4c5-4669-b603-f0bdc53d72ae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:22.794612 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a8a63304-d4c5-4669-b603-f0bdc53d72ae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:22.795378 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a8a63304-d4c5-4669-b603-f0bdc53d72ae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:22.795822 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a8a63304-d4c5-4669-b603-f0bdc53d72ae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:22.826466 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-4b603253-f92e-449a-bedb-67f43ae58e36 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:22.827203 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-4b603253-f92e-449a-bedb-67f43ae58e36 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: 46fa6d8c-afd7-4385-a727-ee8d14223669] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:22.833785 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4b603253-f92e-449a-bedb-67f43ae58e36 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:22.834396 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4b603253-f92e-449a-bedb-67f43ae58e36 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:22.835169 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4b603253-f92e-449a-bedb-67f43ae58e36 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:22.835608 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4b603253-f92e-449a-bedb-67f43ae58e36 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:22.990424 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-a8a63304-d4c5-4669-b603-f0bdc53d72ae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:23.001726 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a8a63304-d4c5-4669-b603-f0bdc53d72ae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.218666 Jun 22 09:17:23.013080 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 613/1177] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:22 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:23.019233 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-4201bf0b-c51f-423d-a7d3-d9079be60986 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:23.020203 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-4201bf0b-c51f-423d-a7d3-d9079be60986 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:23.025083 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-4b603253-f92e-449a-bedb-67f43ae58e36 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:23.029088 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4201bf0b-c51f-423d-a7d3-d9079be60986 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:23.029790 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4201bf0b-c51f-423d-a7d3-d9079be60986 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:23.032381 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4201bf0b-c51f-423d-a7d3-d9079be60986 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:23.032848 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-4b603253-f92e-449a-bedb-67f43ae58e36 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669" status: 200 len: 1365 microversion: 2.1 time: 0.210148 Jun 22 09:17:23.033394 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4201bf0b-c51f-423d-a7d3-d9079be60986 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:23.043271 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 565/1178] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:22 2022] GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669 => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:17:23.067294 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-4201bf0b-c51f-423d-a7d3-d9079be60986 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052793 Jun 22 09:17:23.068244 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 614/1179] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:23 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:23.203698 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [req-58c1bceb-1f4c-47c2-9b33-d507f19fddc9 req-210dc70b-d9e9-4de4-982c-617782e79649 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46fa6d8c-afd7-4385-a727-ee8d14223669", "tag": "566d62a3-e2c4-4f86-b042-d41e7f9f5f68"}]} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:17:23.221177 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-58c1bceb-1f4c-47c2-9b33-d507f19fddc9 req-210dc70b-d9e9-4de4-982c-617782e79649 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:23.221757 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-58c1bceb-1f4c-47c2-9b33-d507f19fddc9 req-210dc70b-d9e9-4de4-982c-617782e79649 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:23.235204 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.compute.server_external_events [req-58c1bceb-1f4c-47c2-9b33-d507f19fddc9 req-210dc70b-d9e9-4de4-982c-617782e79649 service nova] Creating event network-changed:566d62a3-e2c4-4f86-b042-d41e7f9f5f68 for instance 46fa6d8c-afd7-4385-a727-ee8d14223669 on hv-cinder-84599 Jun 22 09:17:23.240533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [req-58c1bceb-1f4c-47c2-9b33-d507f19fddc9 req-210dc70b-d9e9-4de4-982c-617782e79649 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047614 Jun 22 09:17:23.241187 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 566/1180] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:24.019419 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2cedaba4-cc65-4d6a-a871-b248cd218ed4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:24.020032 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2cedaba4-cc65-4d6a-a871-b248cd218ed4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:24.027060 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2cedaba4-cc65-4d6a-a871-b248cd218ed4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:24.027614 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2cedaba4-cc65-4d6a-a871-b248cd218ed4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:24.028430 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2cedaba4-cc65-4d6a-a871-b248cd218ed4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:24.028906 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2cedaba4-cc65-4d6a-a871-b248cd218ed4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:24.051484 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1e4b6e25-56c8-4cf5-91c3-9487148d3892 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:24.052492 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1e4b6e25-56c8-4cf5-91c3-9487148d3892 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: 46fa6d8c-afd7-4385-a727-ee8d14223669] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:24.059675 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1e4b6e25-56c8-4cf5-91c3-9487148d3892 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:24.060258 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1e4b6e25-56c8-4cf5-91c3-9487148d3892 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:24.061192 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1e4b6e25-56c8-4cf5-91c3-9487148d3892 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:24.061759 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1e4b6e25-56c8-4cf5-91c3-9487148d3892 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:24.216307 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-2cedaba4-cc65-4d6a-a871-b248cd218ed4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:24.225281 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2cedaba4-cc65-4d6a-a871-b248cd218ed4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.209642 Jun 22 09:17:24.226175 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 615/1181] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:24 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:24.231024 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9f536b4e-cfe9-4b43-82a2-a7716173bf57 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:24.231940 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9f536b4e-cfe9-4b43-82a2-a7716173bf57 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:24.238683 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9f536b4e-cfe9-4b43-82a2-a7716173bf57 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:24.239134 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9f536b4e-cfe9-4b43-82a2-a7716173bf57 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:24.239903 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9f536b4e-cfe9-4b43-82a2-a7716173bf57 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:24.240342 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9f536b4e-cfe9-4b43-82a2-a7716173bf57 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:24.243071 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-1e4b6e25-56c8-4cf5-91c3-9487148d3892 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:24.252730 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1e4b6e25-56c8-4cf5-91c3-9487148d3892 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669" status: 200 len: 1365 microversion: 2.1 time: 0.206089 Jun 22 09:17:24.253424 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 567/1182] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:24 2022] GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669 => generated 1365 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:17:24.275580 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9f536b4e-cfe9-4b43-82a2-a7716173bf57 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048315 Jun 22 09:17:24.276169 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 616/1183] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:24 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:25.241906 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-614f1320-e691-4fac-b803-169cfc4fa373 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:25.242515 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-614f1320-e691-4fac-b803-169cfc4fa373 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:25.249029 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-614f1320-e691-4fac-b803-169cfc4fa373 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:25.249483 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-614f1320-e691-4fac-b803-169cfc4fa373 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:25.250946 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-614f1320-e691-4fac-b803-169cfc4fa373 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:25.251379 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-614f1320-e691-4fac-b803-169cfc4fa373 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:25.270904 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-fa70e7ef-4762-4c9d-b7ba-f405e5d98525 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:25.271787 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-fa70e7ef-4762-4c9d-b7ba-f405e5d98525 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: 46fa6d8c-afd7-4385-a727-ee8d14223669] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:25.278249 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fa70e7ef-4762-4c9d-b7ba-f405e5d98525 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:25.278700 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fa70e7ef-4762-4c9d-b7ba-f405e5d98525 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:25.279495 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fa70e7ef-4762-4c9d-b7ba-f405e5d98525 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:25.279938 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fa70e7ef-4762-4c9d-b7ba-f405e5d98525 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:25.430590 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-614f1320-e691-4fac-b803-169cfc4fa373 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:25.433692 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=100 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:25.441117 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-614f1320-e691-4fac-b803-169cfc4fa373 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.202899 Jun 22 09:17:25.441698 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 568/1184] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:25 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:25.446434 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-4d8dd208-6453-4e55-a615-a925f760e519 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:25.447367 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-4d8dd208-6453-4e55-a615-a925f760e519 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:25.453644 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4d8dd208-6453-4e55-a615-a925f760e519 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:25.454090 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4d8dd208-6453-4e55-a615-a925f760e519 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:25.454853 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4d8dd208-6453-4e55-a615-a925f760e519 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:25.455477 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4d8dd208-6453-4e55-a615-a925f760e519 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:25.460034 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-fa70e7ef-4762-4c9d-b7ba-f405e5d98525 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:25.467673 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-fa70e7ef-4762-4c9d-b7ba-f405e5d98525 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669" status: 200 len: 1365 microversion: 2.1 time: 0.200666 Jun 22 09:17:25.468276 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 617/1185] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:25 2022] GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669 => generated 1365 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:17:25.487227 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-4d8dd208-6453-4e55-a615-a925f760e519 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044517 Jun 22 09:17:25.487771 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 569/1186] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:25 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:26.463205 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-35b7a921-c313-4a59-b902-cfc9c299d4b3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:26.463844 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-35b7a921-c313-4a59-b902-cfc9c299d4b3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:26.470982 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-35b7a921-c313-4a59-b902-cfc9c299d4b3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:26.471499 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-35b7a921-c313-4a59-b902-cfc9c299d4b3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:26.472269 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-35b7a921-c313-4a59-b902-cfc9c299d4b3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:26.472712 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-35b7a921-c313-4a59-b902-cfc9c299d4b3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:26.489545 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-13675224-3949-4a12-8791-e05874f8cd05 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:26.489545 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-13675224-3949-4a12-8791-e05874f8cd05 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: 46fa6d8c-afd7-4385-a727-ee8d14223669] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:26.493404 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-13675224-3949-4a12-8791-e05874f8cd05 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:26.493928 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-13675224-3949-4a12-8791-e05874f8cd05 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:26.494758 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-13675224-3949-4a12-8791-e05874f8cd05 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:26.495259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-13675224-3949-4a12-8791-e05874f8cd05 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:26.688679 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-13675224-3949-4a12-8791-e05874f8cd05 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:26.691698 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-35b7a921-c313-4a59-b902-cfc9c299d4b3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:26.697112 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-13675224-3949-4a12-8791-e05874f8cd05 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669" status: 200 len: 1365 microversion: 2.1 time: 0.216134 Jun 22 09:17:26.697985 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 570/1187] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:26 2022] GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669 => generated 1365 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:17:26.699574 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-35b7a921-c313-4a59-b902-cfc9c299d4b3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.240146 Jun 22 09:17:26.700230 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 618/1188] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:26 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:26.708824 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c4038718-0894-4a02-ba75-297a6dc6f1bd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:26.708824 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c4038718-0894-4a02-ba75-297a6dc6f1bd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:26.710580 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c4038718-0894-4a02-ba75-297a6dc6f1bd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:26.711036 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c4038718-0894-4a02-ba75-297a6dc6f1bd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:26.711793 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c4038718-0894-4a02-ba75-297a6dc6f1bd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:26.712231 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c4038718-0894-4a02-ba75-297a6dc6f1bd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:26.743377 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c4038718-0894-4a02-ba75-297a6dc6f1bd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044264 Jun 22 09:17:26.743845 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 571/1189] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:26 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:27.714203 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-fe3af968-521f-4231-8d4d-02cde6dcccc1 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:27.714918 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-fe3af968-521f-4231-8d4d-02cde6dcccc1 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: 46fa6d8c-afd7-4385-a727-ee8d14223669] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:27.717609 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b649edcc-7afa-4321-aede-95174d2ddbec tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:27.718952 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-b649edcc-7afa-4321-aede-95174d2ddbec tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:27.722250 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fe3af968-521f-4231-8d4d-02cde6dcccc1 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:27.722900 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fe3af968-521f-4231-8d4d-02cde6dcccc1 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:27.723864 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fe3af968-521f-4231-8d4d-02cde6dcccc1 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:27.724501 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fe3af968-521f-4231-8d4d-02cde6dcccc1 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:27.725370 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b649edcc-7afa-4321-aede-95174d2ddbec tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:27.725877 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b649edcc-7afa-4321-aede-95174d2ddbec tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:27.726590 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b649edcc-7afa-4321-aede-95174d2ddbec tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:27.727031 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b649edcc-7afa-4321-aede-95174d2ddbec tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:27.927489 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-fe3af968-521f-4231-8d4d-02cde6dcccc1 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:27.930053 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-b649edcc-7afa-4321-aede-95174d2ddbec tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:27.935161 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-fe3af968-521f-4231-8d4d-02cde6dcccc1 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669" status: 200 len: 1365 microversion: 2.1 time: 0.225051 Jun 22 09:17:27.935928 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 619/1190] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:27 2022] GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669 => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:27.940419 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-62e5d2c3-e000-42df-86f9-104aafa1deef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:27.941506 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-62e5d2c3-e000-42df-86f9-104aafa1deef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:27.947579 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-62e5d2c3-e000-42df-86f9-104aafa1deef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:27.948035 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-62e5d2c3-e000-42df-86f9-104aafa1deef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:27.949045 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-62e5d2c3-e000-42df-86f9-104aafa1deef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:27.949540 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-62e5d2c3-e000-42df-86f9-104aafa1deef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:27.952313 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-b649edcc-7afa-4321-aede-95174d2ddbec tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.238773 Jun 22 09:17:27.953625 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 572/1191] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:27 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:17:27.982275 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-62e5d2c3-e000-42df-86f9-104aafa1deef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045484 Jun 22 09:17:27.982990 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 620/1192] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:27 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:28.951450 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-23371c7d-9398-4e46-9e65-0efa78e45cef tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:28.952142 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-23371c7d-9398-4e46-9e65-0efa78e45cef tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: 46fa6d8c-afd7-4385-a727-ee8d14223669] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:28.959872 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-23371c7d-9398-4e46-9e65-0efa78e45cef tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:28.960327 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-23371c7d-9398-4e46-9e65-0efa78e45cef tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:28.961123 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-23371c7d-9398-4e46-9e65-0efa78e45cef tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:28.961568 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-23371c7d-9398-4e46-9e65-0efa78e45cef tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:28.969948 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-8f3036db-f11a-4640-beea-4dea1cf60691 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:28.970568 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-8f3036db-f11a-4640-beea-4dea1cf60691 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:28.977216 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8f3036db-f11a-4640-beea-4dea1cf60691 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:28.977666 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8f3036db-f11a-4640-beea-4dea1cf60691 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:28.978431 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8f3036db-f11a-4640-beea-4dea1cf60691 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:28.978870 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8f3036db-f11a-4640-beea-4dea1cf60691 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:29.165513 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-23371c7d-9398-4e46-9e65-0efa78e45cef tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:29.168741 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-8f3036db-f11a-4640-beea-4dea1cf60691 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:29.173512 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-23371c7d-9398-4e46-9e65-0efa78e45cef tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669" status: 200 len: 1365 microversion: 2.1 time: 0.225927 Jun 22 09:17:29.174075 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 573/1193] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:28 2022] GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669 => generated 1365 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:29.177452 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-8f3036db-f11a-4640-beea-4dea1cf60691 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.211473 Jun 22 09:17:29.178077 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 621/1194] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:28 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:17:29.178577 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-2b3e936e-6565-427d-a618-c10f8ef051db tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:29.179487 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-2b3e936e-6565-427d-a618-c10f8ef051db tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:29.185810 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2b3e936e-6565-427d-a618-c10f8ef051db tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:29.186258 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2b3e936e-6565-427d-a618-c10f8ef051db tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:29.187723 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2b3e936e-6565-427d-a618-c10f8ef051db tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:29.188332 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2b3e936e-6565-427d-a618-c10f8ef051db tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:29.217033 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-2b3e936e-6565-427d-a618-c10f8ef051db tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041894 Jun 22 09:17:29.217586 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 574/1195] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:29 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:29.840047 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell0:SELECT=6 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:29.899226 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-945b550e-1c8a-4959-ab6f-056587b2cb16 req-06ec3458-e392-4e68-8c88-c07e60e312dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46fa6d8c-afd7-4385-a727-ee8d14223669", "name": "network-vif-plugged", "status": "completed", "tag": "566d62a3-e2c4-4f86-b042-d41e7f9f5f68"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:17:29.908023 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-945b550e-1c8a-4959-ab6f-056587b2cb16 req-06ec3458-e392-4e68-8c88-c07e60e312dc service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:29.908468 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-945b550e-1c8a-4959-ab6f-056587b2cb16 req-06ec3458-e392-4e68-8c88-c07e60e312dc service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:29.919257 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-945b550e-1c8a-4959-ab6f-056587b2cb16 req-06ec3458-e392-4e68-8c88-c07e60e312dc service nova] Creating event network-vif-plugged:566d62a3-e2c4-4f86-b042-d41e7f9f5f68 for instance 46fa6d8c-afd7-4385-a727-ee8d14223669 on hv-cinder-84599 Jun 22 09:17:29.925759 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-945b550e-1c8a-4959-ab6f-056587b2cb16 req-06ec3458-e392-4e68-8c88-c07e60e312dc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090015 Jun 22 09:17:29.926613 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 622/1196] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:30.192056 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3d1b4d80-2ea3-4c01-b52b-c62281fedaab tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:30.192761 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3d1b4d80-2ea3-4c01-b52b-c62281fedaab tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: 46fa6d8c-afd7-4385-a727-ee8d14223669] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:30.194708 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell0:SELECT=2 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:30.195462 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell0:SELECT=6 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:30.197502 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-1fe94e7f-0db8-4de7-b03e-a97acd6fe092 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:30.198288 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-1fe94e7f-0db8-4de7-b03e-a97acd6fe092 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:30.201510 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3d1b4d80-2ea3-4c01-b52b-c62281fedaab tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:30.213024 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3d1b4d80-2ea3-4c01-b52b-c62281fedaab tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:30.213024 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3d1b4d80-2ea3-4c01-b52b-c62281fedaab tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:30.213024 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3d1b4d80-2ea3-4c01-b52b-c62281fedaab tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:30.213456 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1fe94e7f-0db8-4de7-b03e-a97acd6fe092 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:30.213456 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1fe94e7f-0db8-4de7-b03e-a97acd6fe092 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:30.213456 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1fe94e7f-0db8-4de7-b03e-a97acd6fe092 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:30.213456 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1fe94e7f-0db8-4de7-b03e-a97acd6fe092 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:30.404048 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3d1b4d80-2ea3-4c01-b52b-c62281fedaab tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:30.407385 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-1fe94e7f-0db8-4de7-b03e-a97acd6fe092 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:30.415375 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-1fe94e7f-0db8-4de7-b03e-a97acd6fe092 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.224577 Jun 22 09:17:30.415953 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 623/1197] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:30 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:17:30.420175 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3d1b4d80-2ea3-4c01-b52b-c62281fedaab tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669" status: 200 len: 1365 microversion: 2.1 time: 0.233246 Jun 22 09:17:30.420507 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-67cc0c11-80f6-45bb-9fb2-39c8f30465f9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:30.422501 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-67cc0c11-80f6-45bb-9fb2-39c8f30465f9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:30.429114 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-67cc0c11-80f6-45bb-9fb2-39c8f30465f9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:30.429619 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-67cc0c11-80f6-45bb-9fb2-39c8f30465f9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:30.430345 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-67cc0c11-80f6-45bb-9fb2-39c8f30465f9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:30.430792 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-67cc0c11-80f6-45bb-9fb2-39c8f30465f9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:30.432230 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 575/1198] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:30 2022] GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669 => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:30.460651 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-67cc0c11-80f6-45bb-9fb2-39c8f30465f9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043665 Jun 22 09:17:30.463307 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 624/1199] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:30 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:31.434995 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-be207f8c-755e-40d4-aba7-a3487da0bbe7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:31.435567 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-be207f8c-755e-40d4-aba7-a3487da0bbe7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:31.440028 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-ce77ab0c-1dd1-4861-9878-c1fcd83b484c tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:31.440511 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-ce77ab0c-1dd1-4861-9878-c1fcd83b484c tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: 46fa6d8c-afd7-4385-a727-ee8d14223669] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:31.443380 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-be207f8c-755e-40d4-aba7-a3487da0bbe7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:31.443823 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-be207f8c-755e-40d4-aba7-a3487da0bbe7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:31.444588 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-be207f8c-755e-40d4-aba7-a3487da0bbe7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:31.445052 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-be207f8c-755e-40d4-aba7-a3487da0bbe7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:31.446823 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ce77ab0c-1dd1-4861-9878-c1fcd83b484c tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:31.447275 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ce77ab0c-1dd1-4861-9878-c1fcd83b484c tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:31.448037 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ce77ab0c-1dd1-4861-9878-c1fcd83b484c tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:31.448475 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ce77ab0c-1dd1-4861-9878-c1fcd83b484c tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:31.631859 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-be207f8c-755e-40d4-aba7-a3487da0bbe7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:31.635929 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-ce77ab0c-1dd1-4861-9878-c1fcd83b484c tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:31.640061 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-be207f8c-755e-40d4-aba7-a3487da0bbe7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.209882 Jun 22 09:17:31.640652 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 576/1200] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:31 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:31.644312 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-ce77ab0c-1dd1-4861-9878-c1fcd83b484c tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669" status: 200 len: 1365 microversion: 2.1 time: 0.208786 Jun 22 09:17:31.645390 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-5f4d6956-979a-46ff-8001-32a24fdc8643 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:31.646568 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-5f4d6956-979a-46ff-8001-32a24fdc8643 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:31.653069 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5f4d6956-979a-46ff-8001-32a24fdc8643 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:31.653517 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5f4d6956-979a-46ff-8001-32a24fdc8643 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:31.654082 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 625/1201] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:31 2022] GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:17:31.654278 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5f4d6956-979a-46ff-8001-32a24fdc8643 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:31.654715 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5f4d6956-979a-46ff-8001-32a24fdc8643 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:31.685896 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-5f4d6956-979a-46ff-8001-32a24fdc8643 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044017 Jun 22 09:17:31.686361 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 577/1202] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:31 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:32.661371 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f7e8afde-5b5d-4498-99f9-9d43ed0526ba tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:32.662072 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7732f764-0c62-48dd-88d0-b8d0cdccbd19 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:32.662465 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f7e8afde-5b5d-4498-99f9-9d43ed0526ba tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:32.662577 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7732f764-0c62-48dd-88d0-b8d0cdccbd19 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: 46fa6d8c-afd7-4385-a727-ee8d14223669] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:32.668515 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f7e8afde-5b5d-4498-99f9-9d43ed0526ba tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:32.668691 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7732f764-0c62-48dd-88d0-b8d0cdccbd19 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:32.669065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f7e8afde-5b5d-4498-99f9-9d43ed0526ba tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:32.669225 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7732f764-0c62-48dd-88d0-b8d0cdccbd19 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:32.669828 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f7e8afde-5b5d-4498-99f9-9d43ed0526ba tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:32.669953 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7732f764-0c62-48dd-88d0-b8d0cdccbd19 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:32.670258 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f7e8afde-5b5d-4498-99f9-9d43ed0526ba tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:32.670374 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7732f764-0c62-48dd-88d0-b8d0cdccbd19 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:32.674199 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=100 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:32.860645 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7732f764-0c62-48dd-88d0-b8d0cdccbd19 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:32.868169 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7732f764-0c62-48dd-88d0-b8d0cdccbd19 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669" status: 200 len: 1554 microversion: 2.1 time: 0.210606 Jun 22 09:17:32.868742 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 626/1203] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:32 2022] GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669 => generated 1554 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:32.871591 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-f7e8afde-5b5d-4498-99f9-9d43ed0526ba tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:32.873863 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7c54d3ea-c2f2-4375-ad11-fe52ef6148c7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:32.875464 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7c54d3ea-c2f2-4375-ad11-fe52ef6148c7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:32.881062 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f7e8afde-5b5d-4498-99f9-9d43ed0526ba tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.223490 Jun 22 09:17:32.881623 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 578/1204] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:32 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:32.881958 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7c54d3ea-c2f2-4375-ad11-fe52ef6148c7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:32.882664 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7c54d3ea-c2f2-4375-ad11-fe52ef6148c7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:32.883660 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7c54d3ea-c2f2-4375-ad11-fe52ef6148c7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:32.884109 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7c54d3ea-c2f2-4375-ad11-fe52ef6148c7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:32.886387 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-e0b8d9a4-ec62-428a-b83a-0e8c517fbb4b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:32.886880 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-e0b8d9a4-ec62-428a-b83a-0e8c517fbb4b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: 46fa6d8c-afd7-4385-a727-ee8d14223669] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:32.893426 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e0b8d9a4-ec62-428a-b83a-0e8c517fbb4b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:32.893873 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e0b8d9a4-ec62-428a-b83a-0e8c517fbb4b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:32.894833 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e0b8d9a4-ec62-428a-b83a-0e8c517fbb4b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:32.895422 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e0b8d9a4-ec62-428a-b83a-0e8c517fbb4b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:32.914614 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7c54d3ea-c2f2-4375-ad11-fe52ef6148c7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044334 Jun 22 09:17:32.915100 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 627/1205] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:32 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:32.983000 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-e0b8d9a4-ec62-428a-b83a-0e8c517fbb4b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100275 Jun 22 09:17:32.984174 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 579/1206] 10.222.0.16 () {58 vars in 1274 bytes} [Wed Jun 22 09:17:32 2022] GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:33.899084 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d42d4633-e441-42f9-ac7e-097b48e60901 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:33.899844 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-d42d4633-e441-42f9-ac7e-097b48e60901 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:33.907663 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d42d4633-e441-42f9-ac7e-097b48e60901 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:33.908113 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d42d4633-e441-42f9-ac7e-097b48e60901 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:33.908926 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d42d4633-e441-42f9-ac7e-097b48e60901 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:33.909370 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d42d4633-e441-42f9-ac7e-097b48e60901 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:33.927166 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a93510f4-4d15-43e9-b166-beecdd1f5af7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:33.928335 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a93510f4-4d15-43e9-b166-beecdd1f5af7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:33.934753 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a93510f4-4d15-43e9-b166-beecdd1f5af7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:33.935346 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a93510f4-4d15-43e9-b166-beecdd1f5af7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:33.936223 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a93510f4-4d15-43e9-b166-beecdd1f5af7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:33.937050 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a93510f4-4d15-43e9-b166-beecdd1f5af7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:33.970117 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a93510f4-4d15-43e9-b166-beecdd1f5af7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047617 Jun 22 09:17:33.971039 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 580/1207] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:33 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:17:34.184448 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-d42d4633-e441-42f9-ac7e-097b48e60901 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:34.192845 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d42d4633-e441-42f9-ac7e-097b48e60901 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.297847 Jun 22 09:17:34.193634 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 628/1208] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:33 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:34.386781 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [req-7f6c6b7a-bc34-49f6-9fdc-b07a89a32dda req-94b2d145-2d62-4299-a7a4-430b5ec70ec0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46fa6d8c-afd7-4385-a727-ee8d14223669", "tag": "566d62a3-e2c4-4f86-b042-d41e7f9f5f68"}]} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:17:34.395451 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-7f6c6b7a-bc34-49f6-9fdc-b07a89a32dda req-94b2d145-2d62-4299-a7a4-430b5ec70ec0 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:34.395890 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-7f6c6b7a-bc34-49f6-9fdc-b07a89a32dda req-94b2d145-2d62-4299-a7a4-430b5ec70ec0 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:34.407689 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.compute.server_external_events [req-7f6c6b7a-bc34-49f6-9fdc-b07a89a32dda req-94b2d145-2d62-4299-a7a4-430b5ec70ec0 service nova] Creating event network-changed:566d62a3-e2c4-4f86-b042-d41e7f9f5f68 for instance 46fa6d8c-afd7-4385-a727-ee8d14223669 on hv-cinder-84599 Jun 22 09:17:34.412945 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [req-7f6c6b7a-bc34-49f6-9fdc-b07a89a32dda req-94b2d145-2d62-4299-a7a4-430b5ec70ec0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085773 Jun 22 09:17:34.413795 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 581/1209] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:34.983107 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-6f0a2597-998a-4e88-87e0-06b6e05123ea tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:34.985378 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-6f0a2597-998a-4e88-87e0-06b6e05123ea tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:34.992001 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6f0a2597-998a-4e88-87e0-06b6e05123ea tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:34.992460 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6f0a2597-998a-4e88-87e0-06b6e05123ea tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:34.993268 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6f0a2597-998a-4e88-87e0-06b6e05123ea tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:34.993887 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6f0a2597-998a-4e88-87e0-06b6e05123ea tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:35.027769 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-6f0a2597-998a-4e88-87e0-06b6e05123ea tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049068 Jun 22 09:17:35.028337 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 629/1210] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:34 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:35.210317 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-e6fa95c3-2f2c-4ab0-a189-d1ba20491134 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:35.211019 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-e6fa95c3-2f2c-4ab0-a189-d1ba20491134 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:35.218828 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e6fa95c3-2f2c-4ab0-a189-d1ba20491134 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:35.219254 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e6fa95c3-2f2c-4ab0-a189-d1ba20491134 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:35.220026 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e6fa95c3-2f2c-4ab0-a189-d1ba20491134 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:35.220461 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e6fa95c3-2f2c-4ab0-a189-d1ba20491134 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:35.355418 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-e6fa95c3-2f2c-4ab0-a189-d1ba20491134 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:35.363725 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-e6fa95c3-2f2c-4ab0-a189-d1ba20491134 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.157696 Jun 22 09:17:35.364293 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 582/1211] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:35 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:36.040074 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-4d05e036-239a-44b5-a217-028c303a32fb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:36.041031 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-4d05e036-239a-44b5-a217-028c303a32fb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:36.047571 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4d05e036-239a-44b5-a217-028c303a32fb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:36.048020 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4d05e036-239a-44b5-a217-028c303a32fb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:36.048799 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4d05e036-239a-44b5-a217-028c303a32fb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:36.049239 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4d05e036-239a-44b5-a217-028c303a32fb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:36.078694 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-4d05e036-239a-44b5-a217-028c303a32fb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042553 Jun 22 09:17:36.079250 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 630/1212] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:36 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:36.381234 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-e805f433-1bed-4b23-b2d3-c5858648baf5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:36.381878 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-e805f433-1bed-4b23-b2d3-c5858648baf5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:36.388268 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e805f433-1bed-4b23-b2d3-c5858648baf5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:36.388725 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e805f433-1bed-4b23-b2d3-c5858648baf5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:36.389594 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e805f433-1bed-4b23-b2d3-c5858648baf5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:36.390760 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e805f433-1bed-4b23-b2d3-c5858648baf5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:36.518763 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-e805f433-1bed-4b23-b2d3-c5858648baf5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:36.526901 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-e805f433-1bed-4b23-b2d3-c5858648baf5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149547 Jun 22 09:17:36.527456 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 583/1213] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:36 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:37.090633 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-ffd6a5b0-977b-43e2-b40b-a49396bf59b2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:37.091493 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-ffd6a5b0-977b-43e2-b40b-a49396bf59b2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:37.098753 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ffd6a5b0-977b-43e2-b40b-a49396bf59b2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:37.102026 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ffd6a5b0-977b-43e2-b40b-a49396bf59b2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:37.102026 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ffd6a5b0-977b-43e2-b40b-a49396bf59b2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:37.102026 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ffd6a5b0-977b-43e2-b40b-a49396bf59b2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:37.131436 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-ffd6a5b0-977b-43e2-b40b-a49396bf59b2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044925 Jun 22 09:17:37.131992 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 631/1214] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:37 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:37.543427 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-d17ca4e3-ba38-43c1-8274-94507032b17e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:37.544041 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-d17ca4e3-ba38-43c1-8274-94507032b17e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:37.550744 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d17ca4e3-ba38-43c1-8274-94507032b17e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:37.551217 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d17ca4e3-ba38-43c1-8274-94507032b17e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:37.551974 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d17ca4e3-ba38-43c1-8274-94507032b17e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:37.552413 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d17ca4e3-ba38-43c1-8274-94507032b17e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:37.678318 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-d17ca4e3-ba38-43c1-8274-94507032b17e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:37.686355 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-d17ca4e3-ba38-43c1-8274-94507032b17e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.146774 Jun 22 09:17:37.687343 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 584/1215] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:37 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:38.054917 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-745def91-ec96-4968-8b9a-dcbbf8a8f35a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:38.055416 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-745def91-ec96-4968-8b9a-dcbbf8a8f35a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: 626992c9-801c-488f-98ca-253f69a7d46f] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:38.062092 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-745def91-ec96-4968-8b9a-dcbbf8a8f35a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:38.062648 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-745def91-ec96-4968-8b9a-dcbbf8a8f35a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:38.063416 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-745def91-ec96-4968-8b9a-dcbbf8a8f35a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:38.063858 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-745def91-ec96-4968-8b9a-dcbbf8a8f35a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:38.089945 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-745def91-ec96-4968-8b9a-dcbbf8a8f35a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: 626992c9-801c-488f-98ca-253f69a7d46f] Going to try to terminate instance {{(pid=118025) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:17:38.142779 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-d13fadb6-8efc-44b4-9c43-1592cbb46e90 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:38.143731 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-d13fadb6-8efc-44b4-9c43-1592cbb46e90 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:38.149981 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d13fadb6-8efc-44b4-9c43-1592cbb46e90 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:38.150426 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d13fadb6-8efc-44b4-9c43-1592cbb46e90 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:38.151181 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d13fadb6-8efc-44b4-9c43-1592cbb46e90 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:38.151616 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d13fadb6-8efc-44b4-9c43-1592cbb46e90 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:38.181094 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-d13fadb6-8efc-44b4-9c43-1592cbb46e90 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042841 Jun 22 09:17:38.181648 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 585/1216] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:38 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:17:38.379090 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-745def91-ec96-4968-8b9a-dcbbf8a8f35a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "DELETE /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f" status: 204 len: 0 microversion: 2.20 time: 0.327756 Jun 22 09:17:38.379816 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 632/1217] 10.222.0.16 () {60 vars in 1279 bytes} [Wed Jun 22 09:17:38 2022] DELETE /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 22 09:17:38.388242 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-04f24f6d-d012-4158-98cd-f06031e8ceae tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:38.388962 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-04f24f6d-d012-4158-98cd-f06031e8ceae tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: 626992c9-801c-488f-98ca-253f69a7d46f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:38.396204 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-04f24f6d-d012-4158-98cd-f06031e8ceae tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:38.396660 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-04f24f6d-d012-4158-98cd-f06031e8ceae tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:38.397455 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-04f24f6d-d012-4158-98cd-f06031e8ceae tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:38.397897 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-04f24f6d-d012-4158-98cd-f06031e8ceae tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:38.413379 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=100 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:38.532719 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-04f24f6d-d012-4158-98cd-f06031e8ceae tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:38.540630 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-04f24f6d-d012-4158-98cd-f06031e8ceae tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:38.542181 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-04f24f6d-d012-4158-98cd-f06031e8ceae tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:38.543330 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-04f24f6d-d012-4158-98cd-f06031e8ceae tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f" status: 200 len: 1721 microversion: 2.20 time: 0.159166 Jun 22 09:17:38.543885 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 586/1218] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 09:17:38 2022] GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:17:38.704538 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7f2c11fd-cb8c-4119-a335-efaad8461ffd tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:38.705283 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7f2c11fd-cb8c-4119-a335-efaad8461ffd tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:38.711564 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7f2c11fd-cb8c-4119-a335-efaad8461ffd tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:38.712022 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7f2c11fd-cb8c-4119-a335-efaad8461ffd tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:38.712867 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7f2c11fd-cb8c-4119-a335-efaad8461ffd tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:38.713322 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7f2c11fd-cb8c-4119-a335-efaad8461ffd tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:38.846872 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7f2c11fd-cb8c-4119-a335-efaad8461ffd tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:38.854866 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7f2c11fd-cb8c-4119-a335-efaad8461ffd tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.155025 Jun 22 09:17:38.855426 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 633/1219] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:38 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:39.193088 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-5088a45e-5b33-48f0-be15-1b269f20862a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:39.194091 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-5088a45e-5b33-48f0-be15-1b269f20862a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:39.200745 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5088a45e-5b33-48f0-be15-1b269f20862a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:39.201227 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5088a45e-5b33-48f0-be15-1b269f20862a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:39.202501 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5088a45e-5b33-48f0-be15-1b269f20862a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:39.202941 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5088a45e-5b33-48f0-be15-1b269f20862a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:39.234293 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-5088a45e-5b33-48f0-be15-1b269f20862a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045233 Jun 22 09:17:39.235052 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 587/1220] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:39 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:39.563679 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2e398ec8-a692-486b-99a2-d48b2e666240 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:39.564323 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2e398ec8-a692-486b-99a2-d48b2e666240 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: 626992c9-801c-488f-98ca-253f69a7d46f] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:39.570807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2e398ec8-a692-486b-99a2-d48b2e666240 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:39.571316 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2e398ec8-a692-486b-99a2-d48b2e666240 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:39.572078 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2e398ec8-a692-486b-99a2-d48b2e666240 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:39.572514 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2e398ec8-a692-486b-99a2-d48b2e666240 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:39.707008 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-2e398ec8-a692-486b-99a2-d48b2e666240 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:39.715119 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-2e398ec8-a692-486b-99a2-d48b2e666240 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:39.718351 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-2e398ec8-a692-486b-99a2-d48b2e666240 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:39.720254 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2e398ec8-a692-486b-99a2-d48b2e666240 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f" status: 200 len: 1721 microversion: 2.20 time: 0.161005 Jun 22 09:17:39.720864 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 634/1221] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 09:17:39 2022] GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:17:39.872590 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1962da29-6750-40c3-8c12-6521706442dc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:39.873252 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1962da29-6750-40c3-8c12-6521706442dc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:39.879913 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1962da29-6750-40c3-8c12-6521706442dc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:39.880399 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1962da29-6750-40c3-8c12-6521706442dc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:39.881232 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1962da29-6750-40c3-8c12-6521706442dc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:39.881676 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1962da29-6750-40c3-8c12-6521706442dc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:40.001710 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-55e80ee3-d379-476a-8092-8cab265146cc req-e900a6aa-4537-4870-b5cf-035aaed56252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "626992c9-801c-488f-98ca-253f69a7d46f", "name": "network-vif-deleted", "tag": "e0f42496-f468-41c2-b8b9-2e39e1f86d69"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:17:40.010499 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-55e80ee3-d379-476a-8092-8cab265146cc req-e900a6aa-4537-4870-b5cf-035aaed56252 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:40.010949 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-55e80ee3-d379-476a-8092-8cab265146cc req-e900a6aa-4537-4870-b5cf-035aaed56252 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:40.023751 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-1962da29-6750-40c3-8c12-6521706442dc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:40.023934 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-55e80ee3-d379-476a-8092-8cab265146cc req-e900a6aa-4537-4870-b5cf-035aaed56252 service nova] Creating event network-vif-deleted:e0f42496-f468-41c2-b8b9-2e39e1f86d69 for instance 626992c9-801c-488f-98ca-253f69a7d46f on hv-cinder-84599 Jun 22 09:17:40.029137 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-55e80ee3-d379-476a-8092-8cab265146cc req-e900a6aa-4537-4870-b5cf-035aaed56252 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032147 Jun 22 09:17:40.030721 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 635/1222] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:40.037455 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1962da29-6750-40c3-8c12-6521706442dc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.168480 Jun 22 09:17:40.048843 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 588/1223] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:39 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:40.246148 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e8250de2-e9dc-41d1-9efb-73cdbc74b87f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:40.247327 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e8250de2-e9dc-41d1-9efb-73cdbc74b87f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:40.254452 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e8250de2-e9dc-41d1-9efb-73cdbc74b87f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:40.254912 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e8250de2-e9dc-41d1-9efb-73cdbc74b87f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:40.255683 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e8250de2-e9dc-41d1-9efb-73cdbc74b87f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:40.256129 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e8250de2-e9dc-41d1-9efb-73cdbc74b87f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:40.290934 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e8250de2-e9dc-41d1-9efb-73cdbc74b87f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048808 Jun 22 09:17:40.292360 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 636/1224] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:40 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:40.739483 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3dd98413-38ac-4560-a391-760ed19bc0f9 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:40.740098 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3dd98413-38ac-4560-a391-760ed19bc0f9 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: 626992c9-801c-488f-98ca-253f69a7d46f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:40.746929 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3dd98413-38ac-4560-a391-760ed19bc0f9 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:40.747422 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3dd98413-38ac-4560-a391-760ed19bc0f9 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:40.767593 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3dd98413-38ac-4560-a391-760ed19bc0f9 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:40.767593 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3dd98413-38ac-4560-a391-760ed19bc0f9 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:40.782755 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3dd98413-38ac-4560-a391-760ed19bc0f9 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:40.783327 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3dd98413-38ac-4560-a391-760ed19bc0f9 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:40.783854 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.objects.instance [None req-3dd98413-38ac-4560-a391-760ed19bc0f9 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lazy-loading 'fault' on Instance uuid 626992c9-801c-488f-98ca-253f69a7d46f {{(pid=118024) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:17:40.825937 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3dd98413-38ac-4560-a391-760ed19bc0f9 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:40.835317 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3dd98413-38ac-4560-a391-760ed19bc0f9 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:40.843424 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3dd98413-38ac-4560-a391-760ed19bc0f9 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc534f42584b4e57a4706c81729cacd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b172c496b3304444bd6169a09cff85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:40.843424 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3dd98413-38ac-4560-a391-760ed19bc0f9 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f" status: 200 len: 1371 microversion: 2.20 time: 0.102505 Jun 22 09:17:40.843424 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 589/1225] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 09:17:40 2022] GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:17:41.056709 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-ef95056d-ab6f-4fc1-954d-c4ffc1c3e83a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:41.057350 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-ef95056d-ab6f-4fc1-954d-c4ffc1c3e83a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:41.059803 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:41.065264 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ef95056d-ab6f-4fc1-954d-c4ffc1c3e83a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:41.065717 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ef95056d-ab6f-4fc1-954d-c4ffc1c3e83a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:41.066489 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ef95056d-ab6f-4fc1-954d-c4ffc1c3e83a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:41.066928 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ef95056d-ab6f-4fc1-954d-c4ffc1c3e83a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:41.213020 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-ef95056d-ab6f-4fc1-954d-c4ffc1c3e83a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:41.221450 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-ef95056d-ab6f-4fc1-954d-c4ffc1c3e83a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.168641 Jun 22 09:17:41.222019 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 637/1226] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:41 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:17:41.302933 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-d314d668-b1e1-4e20-ab4c-d09ae36c46ed tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:41.303854 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-d314d668-b1e1-4e20-ab4c-d09ae36c46ed tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:41.310100 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d314d668-b1e1-4e20-ab4c-d09ae36c46ed tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:41.310581 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d314d668-b1e1-4e20-ab4c-d09ae36c46ed tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:41.312137 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d314d668-b1e1-4e20-ab4c-d09ae36c46ed tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:41.312665 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d314d668-b1e1-4e20-ab4c-d09ae36c46ed tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:41.341886 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-d314d668-b1e1-4e20-ab4c-d09ae36c46ed tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042927 Jun 22 09:17:41.342985 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 590/1227] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:41 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:41.856695 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-49a34015-08d1-487e-a524-95d2b72cd21c tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:41.857346 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-49a34015-08d1-487e-a524-95d2b72cd21c tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: 626992c9-801c-488f-98ca-253f69a7d46f] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:41.864661 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-49a34015-08d1-487e-a524-95d2b72cd21c tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:41.865132 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-49a34015-08d1-487e-a524-95d2b72cd21c tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:41.865896 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-49a34015-08d1-487e-a524-95d2b72cd21c tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:41.866336 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-49a34015-08d1-487e-a524-95d2b72cd21c tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:41.879369 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.wsgi [None req-49a34015-08d1-487e-a524-95d2b72cd21c tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] HTTP exception thrown: Instance 626992c9-801c-488f-98ca-253f69a7d46f could not be found. Jun 22 09:17:41.881020 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-49a34015-08d1-487e-a524-95d2b72cd21c tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Request method failure captured: Jun 22 09:17:41.881020 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: request: GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f HTTP/1.1 Jun 22 09:17:41.881020 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept: application/json Jun 22 09:17:41.881020 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept-Encoding: identity Jun 22 09:17:41.881020 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Connection: close Jun 22 09:17:41.881020 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Length: 0 Jun 22 09:17:41.881020 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Type: application/json Jun 22 09:17:41.881020 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Host: 10.222.0.16 Jun 22 09:17:41.881020 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Openstack-System-Scope: None Jun 22 09:17:41.881020 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: User-Agent: python-urllib3/1.26.9 Jun 22 09:17:41.881020 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Auth-Token: gAAAAABistmshaECFGAHnRmYa6rYBXSOVD0Qua4uTG5avt1MhcK74DWY3z7j33DyNyPUEHkNAlpnveIdxiQXR4PVctEysp2-oZYhmBZfOkICvSxCioSV-tQOnSDfZ3AGE3xsfOtBMU0bgwdFz6BzWaVEfy2YGlGG8lqZlzBcaQ5nCEgZDL5ggws Jun 22 09:17:41.881020 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Id: None Jun 22 09:17:41.881020 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Name: None Jun 22 09:17:41.881020 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Identity-Status: Confirmed Jun 22 09:17:41.881020 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Is-Admin-Project: True Jun 22 09:17:41.881020 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 09:17:41.881020 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Id: default Jun 22 09:17:41.881020 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Name: Default Jun 22 09:17:41.881020 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Id: b172c496b3304444bd6169a09cff85d2 Jun 22 09:17:41.881020 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2111643669 Jun 22 09:17:41.881020 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Role: member,reader Jun 22 09:17:41.881020 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Roles: member,reader Jun 22 09:17:41.882855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b172c496b3304444bd6169a09cff85d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b172c496b3304444bd6169a09cff85d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b172c496b3304444bd6169a09cff85d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b172c496b3304444bd6169a09cff85d2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:17:41.882855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2111643669 Jun 22 09:17:41.882855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Id: b172c496b3304444bd6169a09cff85d2 Jun 22 09:17:41.882855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2111643669 Jun 22 09:17:41.882855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User: tempest-AttachVolumeShelveTestJSON-2111643669-project Jun 22 09:17:41.882855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Id: default Jun 22 09:17:41.882855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Name: Default Jun 22 09:17:41.882855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Id: dc534f42584b4e57a4706c81729cacd5 Jun 22 09:17:41.882855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2111643669-project Jun 22 09:17:41.882855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: method: > Jun 22 09:17:41.882855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: exception: Instance 626992c9-801c-488f-98ca-253f69a7d46f could not be found. Jun 22 09:17:41.882855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: action_args: {'id': '626992c9-801c-488f-98ca-253f69a7d46f'} Jun 22 09:17:41.883862 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:17:41.883862 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:17:41.883862 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:17:41.883862 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:17:41.883862 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:17:41.883862 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:17:41.883862 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:17:41.883862 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:17:41.883862 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:17:41.883862 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:17:41.883862 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 626992c9-801c-488f-98ca-253f69a7d46f could not be found. Jun 22 09:17:41.883862 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:17:41.883862 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:17:41.883862 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:17:41.883862 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:17:41.883862 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:17:41.883862 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:17:41.883862 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:17:41.883862 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:17:41.883862 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:17:41.885616 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:17:41.885616 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:17:41.885616 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:17:41.885616 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:17:41.885616 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:17:41.885616 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:17:41.885616 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:17:41.885616 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 626992c9-801c-488f-98ca-253f69a7d46f could not be found. Jun 22 09:17:41.885616 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:17:41.885616 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:17:41.885616 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:17:41.885616 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:17:41.885616 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:17:41.885616 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:17:41.885616 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:17:41.885616 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:17:41.885616 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 626992c9-801c-488f-98ca-253f69a7d46f could not be found. Jun 22 09:17:41.885616 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:17:41.887093 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-49a34015-08d1-487e-a524-95d2b72cd21c tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Returning 404 to user: Instance 626992c9-801c-488f-98ca-253f69a7d46f could not be found. {{(pid=118025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:17:41.887093 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-49a34015-08d1-487e-a524-95d2b72cd21c tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f" status: 404 len: 111 microversion: 2.20 time: 0.029647 Jun 22 09:17:41.887093 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 638/1228] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 09:17:41 2022] GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 09:17:41.891682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-8eda3b31-e6e4-4fe9-8bb7-79a6e615746c tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '.version_select at 0x7f57561bddc0>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:41.961937 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-8eda3b31-e6e4-4fe9-8bb7-79a6e615746c tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1545536871" status: 204 len: 0 microversion: 2.20 time: 0.074352 Jun 22 09:17:41.962512 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 591/1229] 10.222.0.16 () {60 vars in 1261 bytes} [Wed Jun 22 09:17:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1545536871 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 22 09:17:42.239021 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-6096d60d-1640-4adc-88db-50242cd63b4d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:42.239629 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-6096d60d-1640-4adc-88db-50242cd63b4d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:42.246386 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6096d60d-1640-4adc-88db-50242cd63b4d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:42.246841 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6096d60d-1640-4adc-88db-50242cd63b4d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:42.247596 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6096d60d-1640-4adc-88db-50242cd63b4d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:42.248031 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6096d60d-1640-4adc-88db-50242cd63b4d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:42.353856 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-9f7c6c16-f118-47c5-a554-8b693b65f47c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:42.355523 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-9f7c6c16-f118-47c5-a554-8b693b65f47c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:42.363454 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9f7c6c16-f118-47c5-a554-8b693b65f47c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:42.364521 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9f7c6c16-f118-47c5-a554-8b693b65f47c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:42.364957 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9f7c6c16-f118-47c5-a554-8b693b65f47c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:42.365635 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9f7c6c16-f118-47c5-a554-8b693b65f47c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:42.386958 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-6096d60d-1640-4adc-88db-50242cd63b4d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:42.396697 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-6096d60d-1640-4adc-88db-50242cd63b4d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.161495 Jun 22 09:17:42.397812 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 639/1230] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:42 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:42.411607 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-9f7c6c16-f118-47c5-a554-8b693b65f47c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061848 Jun 22 09:17:42.412264 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 592/1231] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:42 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:43.414844 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d4cbd6a6-67ca-4865-ae3a-b57aa08dc875 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:43.415395 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-d4cbd6a6-67ca-4865-ae3a-b57aa08dc875 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:43.422415 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d4cbd6a6-67ca-4865-ae3a-b57aa08dc875 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:43.422613 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-98a9ebb4-f5bb-4f01-b709-1698940b3644 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:43.423074 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d4cbd6a6-67ca-4865-ae3a-b57aa08dc875 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:43.423329 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-98a9ebb4-f5bb-4f01-b709-1698940b3644 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:43.423641 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d4cbd6a6-67ca-4865-ae3a-b57aa08dc875 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:43.424082 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d4cbd6a6-67ca-4865-ae3a-b57aa08dc875 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:43.429754 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-98a9ebb4-f5bb-4f01-b709-1698940b3644 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:43.430201 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-98a9ebb4-f5bb-4f01-b709-1698940b3644 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:43.430962 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-98a9ebb4-f5bb-4f01-b709-1698940b3644 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:43.432998 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-98a9ebb4-f5bb-4f01-b709-1698940b3644 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:43.462726 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-98a9ebb4-f5bb-4f01-b709-1698940b3644 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044386 Jun 22 09:17:43.463294 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 593/1232] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:43 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:17:43.554424 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-d4cbd6a6-67ca-4865-ae3a-b57aa08dc875 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:43.562558 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d4cbd6a6-67ca-4865-ae3a-b57aa08dc875 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.151723 Jun 22 09:17:43.563109 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 640/1233] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:43 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:44.473942 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ff065f0b-0ccc-4b16-a9a0-f186135a9dd3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:44.474839 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ff065f0b-0ccc-4b16-a9a0-f186135a9dd3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:44.481621 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ff065f0b-0ccc-4b16-a9a0-f186135a9dd3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:44.482077 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ff065f0b-0ccc-4b16-a9a0-f186135a9dd3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:44.483449 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ff065f0b-0ccc-4b16-a9a0-f186135a9dd3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:44.484546 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ff065f0b-0ccc-4b16-a9a0-f186135a9dd3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:44.516376 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ff065f0b-0ccc-4b16-a9a0-f186135a9dd3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046499 Jun 22 09:17:44.516962 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 594/1234] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:44 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:44.579376 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-09f10033-383a-4bd9-8891-b8e4dbc0f147 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:44.579989 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-09f10033-383a-4bd9-8891-b8e4dbc0f147 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:44.586477 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-09f10033-383a-4bd9-8891-b8e4dbc0f147 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:44.586922 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-09f10033-383a-4bd9-8891-b8e4dbc0f147 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:44.587675 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-09f10033-383a-4bd9-8891-b8e4dbc0f147 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:44.588110 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-09f10033-383a-4bd9-8891-b8e4dbc0f147 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:44.716256 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-09f10033-383a-4bd9-8891-b8e4dbc0f147 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:44.726479 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-09f10033-383a-4bd9-8891-b8e4dbc0f147 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.150922 Jun 22 09:17:44.726972 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 641/1235] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:44 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:45.527817 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-89245067-ebca-4e61-89c2-2f9b04f2f500 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:45.528743 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-89245067-ebca-4e61-89c2-2f9b04f2f500 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:45.535947 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-89245067-ebca-4e61-89c2-2f9b04f2f500 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:45.536413 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-89245067-ebca-4e61-89c2-2f9b04f2f500 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:45.537244 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-89245067-ebca-4e61-89c2-2f9b04f2f500 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:45.537775 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-89245067-ebca-4e61-89c2-2f9b04f2f500 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:45.567816 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-89245067-ebca-4e61-89c2-2f9b04f2f500 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044037 Jun 22 09:17:45.568378 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 595/1236] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:45 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:45.743794 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-23bce8d1-cc85-4786-a375-dcae1c5fd46a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:45.744324 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-23bce8d1-cc85-4786-a375-dcae1c5fd46a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:45.751674 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-23bce8d1-cc85-4786-a375-dcae1c5fd46a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:45.752198 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-23bce8d1-cc85-4786-a375-dcae1c5fd46a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:45.753006 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-23bce8d1-cc85-4786-a375-dcae1c5fd46a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:45.753449 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-23bce8d1-cc85-4786-a375-dcae1c5fd46a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:45.767806 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:45.880882 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-23bce8d1-cc85-4786-a375-dcae1c5fd46a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:45.888852 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-23bce8d1-cc85-4786-a375-dcae1c5fd46a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.148901 Jun 22 09:17:45.889670 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 642/1237] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:45 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:46.579664 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-8c837ab0-fb2a-4371-bac2-023ff8219838 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:46.580594 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-8c837ab0-fb2a-4371-bac2-023ff8219838 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:46.587140 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8c837ab0-fb2a-4371-bac2-023ff8219838 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:46.587598 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8c837ab0-fb2a-4371-bac2-023ff8219838 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:46.588355 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8c837ab0-fb2a-4371-bac2-023ff8219838 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:46.588800 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8c837ab0-fb2a-4371-bac2-023ff8219838 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:46.619351 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-8c837ab0-fb2a-4371-bac2-023ff8219838 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043882 Jun 22 09:17:46.619974 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 596/1238] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:46 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:46.907095 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9d78ee9b-9012-4ec5-a270-cc7737f69861 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:46.907623 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9d78ee9b-9012-4ec5-a270-cc7737f69861 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:46.914541 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9d78ee9b-9012-4ec5-a270-cc7737f69861 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:46.914985 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9d78ee9b-9012-4ec5-a270-cc7737f69861 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:46.915735 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9d78ee9b-9012-4ec5-a270-cc7737f69861 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:46.916166 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9d78ee9b-9012-4ec5-a270-cc7737f69861 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:47.048955 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9d78ee9b-9012-4ec5-a270-cc7737f69861 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:47.057226 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9d78ee9b-9012-4ec5-a270-cc7737f69861 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.154657 Jun 22 09:17:47.057791 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 643/1239] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:46 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:47.630965 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-9d320116-486c-4af0-95aa-fc0fd48c6910 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:47.632008 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-9d320116-486c-4af0-95aa-fc0fd48c6910 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:47.638651 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9d320116-486c-4af0-95aa-fc0fd48c6910 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:47.639130 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9d320116-486c-4af0-95aa-fc0fd48c6910 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:47.639902 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9d320116-486c-4af0-95aa-fc0fd48c6910 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:47.640338 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9d320116-486c-4af0-95aa-fc0fd48c6910 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:47.671240 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-9d320116-486c-4af0-95aa-fc0fd48c6910 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043570 Jun 22 09:17:47.671963 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 597/1240] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:47 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:48.079924 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-8b27dbf8-3e98-4b20-9a93-75cb31358792 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:48.080557 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-8b27dbf8-3e98-4b20-9a93-75cb31358792 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:48.087110 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8b27dbf8-3e98-4b20-9a93-75cb31358792 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:48.087559 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8b27dbf8-3e98-4b20-9a93-75cb31358792 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:48.088328 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8b27dbf8-3e98-4b20-9a93-75cb31358792 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:48.088770 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8b27dbf8-3e98-4b20-9a93-75cb31358792 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:48.215312 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-8b27dbf8-3e98-4b20-9a93-75cb31358792 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:48.222870 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-8b27dbf8-3e98-4b20-9a93-75cb31358792 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.147449 Jun 22 09:17:48.223432 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 644/1241] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:48 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:48.683137 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-d977fa79-88b8-4a4f-9c01-eca5ee2ed642 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:48.684170 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-d977fa79-88b8-4a4f-9c01-eca5ee2ed642 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:48.691542 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d977fa79-88b8-4a4f-9c01-eca5ee2ed642 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:48.692076 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d977fa79-88b8-4a4f-9c01-eca5ee2ed642 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:48.692865 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d977fa79-88b8-4a4f-9c01-eca5ee2ed642 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:48.693364 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d977fa79-88b8-4a4f-9c01-eca5ee2ed642 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:48.723221 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-d977fa79-88b8-4a4f-9c01-eca5ee2ed642 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043128 Jun 22 09:17:48.723778 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 598/1242] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:48 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:49.240386 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-5a846aa9-a045-4388-ba36-c72046fba7b8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:49.241226 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-5a846aa9-a045-4388-ba36-c72046fba7b8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:49.247697 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5a846aa9-a045-4388-ba36-c72046fba7b8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:49.248139 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5a846aa9-a045-4388-ba36-c72046fba7b8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:49.249126 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5a846aa9-a045-4388-ba36-c72046fba7b8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:49.249535 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5a846aa9-a045-4388-ba36-c72046fba7b8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:49.383919 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-5a846aa9-a045-4388-ba36-c72046fba7b8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:49.392565 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-5a846aa9-a045-4388-ba36-c72046fba7b8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.156203 Jun 22 09:17:49.393160 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 645/1243] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:49 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:49.736306 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-9d5dbc67-31e3-4fc9-8a21-7b685e532432 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:49.737261 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-9d5dbc67-31e3-4fc9-8a21-7b685e532432 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:49.739644 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:49.744273 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9d5dbc67-31e3-4fc9-8a21-7b685e532432 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:49.744808 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9d5dbc67-31e3-4fc9-8a21-7b685e532432 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:49.755450 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9d5dbc67-31e3-4fc9-8a21-7b685e532432 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:49.755450 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9d5dbc67-31e3-4fc9-8a21-7b685e532432 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:49.776395 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-9d5dbc67-31e3-4fc9-8a21-7b685e532432 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044703 Jun 22 09:17:49.776974 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 599/1244] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:49 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:50.410056 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c9985ffe-a9bd-4712-aad8-64f02a307bc2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:50.410594 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c9985ffe-a9bd-4712-aad8-64f02a307bc2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:50.417138 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c9985ffe-a9bd-4712-aad8-64f02a307bc2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:50.417584 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c9985ffe-a9bd-4712-aad8-64f02a307bc2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:50.418336 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c9985ffe-a9bd-4712-aad8-64f02a307bc2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:50.418774 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c9985ffe-a9bd-4712-aad8-64f02a307bc2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:50.546881 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c9985ffe-a9bd-4712-aad8-64f02a307bc2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:50.554874 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c9985ffe-a9bd-4712-aad8-64f02a307bc2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.148808 Jun 22 09:17:50.555444 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 646/1245] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:50 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:50.788740 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-7e4a2553-c48a-4025-8cdd-1e4cf30bba02 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:50.789695 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-7e4a2553-c48a-4025-8cdd-1e4cf30bba02 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:50.797270 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7e4a2553-c48a-4025-8cdd-1e4cf30bba02 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:50.797562 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7e4a2553-c48a-4025-8cdd-1e4cf30bba02 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:50.798324 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7e4a2553-c48a-4025-8cdd-1e4cf30bba02 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:50.798759 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7e4a2553-c48a-4025-8cdd-1e4cf30bba02 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:50.828071 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-7e4a2553-c48a-4025-8cdd-1e4cf30bba02 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043436 Jun 22 09:17:50.828616 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 600/1246] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:50 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:51.573386 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-01c3fa71-b62c-440d-821d-709bc0e3cd7a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:51.574005 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-01c3fa71-b62c-440d-821d-709bc0e3cd7a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:51.580351 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-01c3fa71-b62c-440d-821d-709bc0e3cd7a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:51.580894 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-01c3fa71-b62c-440d-821d-709bc0e3cd7a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:51.581661 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-01c3fa71-b62c-440d-821d-709bc0e3cd7a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:51.582102 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-01c3fa71-b62c-440d-821d-709bc0e3cd7a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:51.710886 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-01c3fa71-b62c-440d-821d-709bc0e3cd7a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:51.719455 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-01c3fa71-b62c-440d-821d-709bc0e3cd7a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.150435 Jun 22 09:17:51.720019 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 647/1247] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:51 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:51.839734 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1fc3d3fe-3e4e-4db2-a6b0-a86bb779c3cd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:51.840798 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1fc3d3fe-3e4e-4db2-a6b0-a86bb779c3cd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:51.847973 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1fc3d3fe-3e4e-4db2-a6b0-a86bb779c3cd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:51.848422 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1fc3d3fe-3e4e-4db2-a6b0-a86bb779c3cd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:51.849213 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1fc3d3fe-3e4e-4db2-a6b0-a86bb779c3cd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:51.849656 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1fc3d3fe-3e4e-4db2-a6b0-a86bb779c3cd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:51.879307 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1fc3d3fe-3e4e-4db2-a6b0-a86bb779c3cd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043901 Jun 22 09:17:51.879853 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 601/1248] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:51 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:52.735794 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-535063fb-90f8-4f23-8f1d-a439fe731a55 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:52.736543 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-535063fb-90f8-4f23-8f1d-a439fe731a55 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:52.742927 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-535063fb-90f8-4f23-8f1d-a439fe731a55 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:52.743356 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-535063fb-90f8-4f23-8f1d-a439fe731a55 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:52.744106 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-535063fb-90f8-4f23-8f1d-a439fe731a55 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:52.744537 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-535063fb-90f8-4f23-8f1d-a439fe731a55 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:52.876619 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-535063fb-90f8-4f23-8f1d-a439fe731a55 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:52.884952 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-535063fb-90f8-4f23-8f1d-a439fe731a55 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.153105 Jun 22 09:17:52.885514 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 648/1249] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:52 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:52.892339 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-4dc43ae8-539b-4cf9-bc58-2bed506f22a7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:52.893334 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-4dc43ae8-539b-4cf9-bc58-2bed506f22a7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:52.900253 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4dc43ae8-539b-4cf9-bc58-2bed506f22a7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:52.900698 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4dc43ae8-539b-4cf9-bc58-2bed506f22a7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:52.901483 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4dc43ae8-539b-4cf9-bc58-2bed506f22a7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:52.901917 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4dc43ae8-539b-4cf9-bc58-2bed506f22a7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:52.931539 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-4dc43ae8-539b-4cf9-bc58-2bed506f22a7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044234 Jun 22 09:17:52.932080 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 602/1250] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:52 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:53.903194 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-38904d41-2046-48cf-b2fb-391881f96f22 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:53.903798 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-38904d41-2046-48cf-b2fb-391881f96f22 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:53.910324 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-38904d41-2046-48cf-b2fb-391881f96f22 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:53.910779 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-38904d41-2046-48cf-b2fb-391881f96f22 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:53.911539 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-38904d41-2046-48cf-b2fb-391881f96f22 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:53.911976 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-38904d41-2046-48cf-b2fb-391881f96f22 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:53.943836 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-9506f104-2484-4dd5-b964-9475115f47ad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:53.944811 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-9506f104-2484-4dd5-b964-9475115f47ad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:53.951713 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9506f104-2484-4dd5-b964-9475115f47ad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:53.952869 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9506f104-2484-4dd5-b964-9475115f47ad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:53.953719 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9506f104-2484-4dd5-b964-9475115f47ad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:53.954253 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9506f104-2484-4dd5-b964-9475115f47ad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:53.981081 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=100 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:53.986653 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-9506f104-2484-4dd5-b964-9475115f47ad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047307 Jun 22 09:17:53.987221 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 603/1251] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:53 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:17:54.054253 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-38904d41-2046-48cf-b2fb-391881f96f22 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:54.062505 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-38904d41-2046-48cf-b2fb-391881f96f22 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.163249 Jun 22 09:17:54.063069 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 649/1252] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:53 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:54.999254 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-58d3bd43-6018-42e4-b1d6-df91a517145d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:55.000239 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-58d3bd43-6018-42e4-b1d6-df91a517145d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:55.006988 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-58d3bd43-6018-42e4-b1d6-df91a517145d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:55.007428 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-58d3bd43-6018-42e4-b1d6-df91a517145d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:55.008714 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-58d3bd43-6018-42e4-b1d6-df91a517145d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:55.008714 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-58d3bd43-6018-42e4-b1d6-df91a517145d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:55.039571 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-58d3bd43-6018-42e4-b1d6-df91a517145d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045316 Jun 22 09:17:55.040169 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 604/1253] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:17:54 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:55.079432 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-96a39d9b-d0ad-4820-8655-f4b0819c0219 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:55.080036 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-96a39d9b-d0ad-4820-8655-f4b0819c0219 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:55.086529 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-96a39d9b-d0ad-4820-8655-f4b0819c0219 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:55.086972 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-96a39d9b-d0ad-4820-8655-f4b0819c0219 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:55.087723 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-96a39d9b-d0ad-4820-8655-f4b0819c0219 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:55.088159 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-96a39d9b-d0ad-4820-8655-f4b0819c0219 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:55.221697 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-96a39d9b-d0ad-4820-8655-f4b0819c0219 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:55.229673 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-96a39d9b-d0ad-4820-8655-f4b0819c0219 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.154049 Jun 22 09:17:55.230231 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 650/1254] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:55 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:56.050986 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1e542e61-6ce0-4512-84dd-c12567f9a286 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:17:56.051921 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1e542e61-6ce0-4512-84dd-c12567f9a286 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:56.058464 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1e542e61-6ce0-4512-84dd-c12567f9a286 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:56.060464 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1e542e61-6ce0-4512-84dd-c12567f9a286 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:56.060464 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1e542e61-6ce0-4512-84dd-c12567f9a286 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:56.060464 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1e542e61-6ce0-4512-84dd-c12567f9a286 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:56.156626 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1e542e61-6ce0-4512-84dd-c12567f9a286 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "POST /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/action" status: 200 len: 75888 microversion: 2.1 time: 0.109349 Jun 22 09:17:56.157298 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 605/1255] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jun 22 09:17:56 2022] POST /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590/action => generated 75888 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 09:17:56.247135 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-4eca40f6-a0ae-4396-9716-bae5b72c971b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:56.247818 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-4eca40f6-a0ae-4396-9716-bae5b72c971b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:56.254603 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4eca40f6-a0ae-4396-9716-bae5b72c971b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:56.255049 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4eca40f6-a0ae-4396-9716-bae5b72c971b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:56.255797 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4eca40f6-a0ae-4396-9716-bae5b72c971b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:56.256229 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4eca40f6-a0ae-4396-9716-bae5b72c971b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:56.382494 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-4eca40f6-a0ae-4396-9716-bae5b72c971b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:56.390547 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-4eca40f6-a0ae-4396-9716-bae5b72c971b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.147345 Jun 22 09:17:56.391104 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 651/1256] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:56 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:57.408003 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-64c9c84a-d9f7-4ee0-b48e-d0dc6f4a21e2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:57.408696 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-64c9c84a-d9f7-4ee0-b48e-d0dc6f4a21e2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:57.416128 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-64c9c84a-d9f7-4ee0-b48e-d0dc6f4a21e2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:57.416574 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-64c9c84a-d9f7-4ee0-b48e-d0dc6f4a21e2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:57.417365 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-64c9c84a-d9f7-4ee0-b48e-d0dc6f4a21e2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:57.417798 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-64c9c84a-d9f7-4ee0-b48e-d0dc6f4a21e2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:57.552253 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-64c9c84a-d9f7-4ee0-b48e-d0dc6f4a21e2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:57.560885 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-64c9c84a-d9f7-4ee0-b48e-d0dc6f4a21e2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.156604 Jun 22 09:17:57.561564 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 606/1257] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:57 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:58.577631 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-64e13310-36fa-410d-ae70-05d7fd3f8474 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:58.578330 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-64e13310-36fa-410d-ae70-05d7fd3f8474 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:58.584743 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-64e13310-36fa-410d-ae70-05d7fd3f8474 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:58.585217 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-64e13310-36fa-410d-ae70-05d7fd3f8474 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:58.585969 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-64e13310-36fa-410d-ae70-05d7fd3f8474 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:58.586406 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-64e13310-36fa-410d-ae70-05d7fd3f8474 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:58.720158 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-64e13310-36fa-410d-ae70-05d7fd3f8474 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:58.728349 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-64e13310-36fa-410d-ae70-05d7fd3f8474 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.154415 Jun 22 09:17:58.728929 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 652/1258] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:58 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:59.745603 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-843b20a3-6956-4ebb-94e3-79857f79ec7b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:59.746219 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-843b20a3-6956-4ebb-94e3-79857f79ec7b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:59.753420 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-843b20a3-6956-4ebb-94e3-79857f79ec7b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:59.753875 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-843b20a3-6956-4ebb-94e3-79857f79ec7b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:59.754641 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-843b20a3-6956-4ebb-94e3-79857f79ec7b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:59.755082 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-843b20a3-6956-4ebb-94e3-79857f79ec7b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:59.883451 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-843b20a3-6956-4ebb-94e3-79857f79ec7b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:59.891432 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-843b20a3-6956-4ebb-94e3-79857f79ec7b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149709 Jun 22 09:17:59.892010 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 607/1259] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:59 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:00.909129 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-0f826fa5-1b81-49b0-83ac-95590c55dadf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:00.909663 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-0f826fa5-1b81-49b0-83ac-95590c55dadf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:00.916223 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0f826fa5-1b81-49b0-83ac-95590c55dadf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:00.916665 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0f826fa5-1b81-49b0-83ac-95590c55dadf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:00.917445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0f826fa5-1b81-49b0-83ac-95590c55dadf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:00.917883 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0f826fa5-1b81-49b0-83ac-95590c55dadf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:01.054399 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-0f826fa5-1b81-49b0-83ac-95590c55dadf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:01.062722 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-0f826fa5-1b81-49b0-83ac-95590c55dadf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.157619 Jun 22 09:18:01.063290 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 653/1260] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:00 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:02.078868 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-daeff039-a7ed-40e9-9e7c-3bffedd39ed6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:02.079484 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-daeff039-a7ed-40e9-9e7c-3bffedd39ed6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:02.086017 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-daeff039-a7ed-40e9-9e7c-3bffedd39ed6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:02.086469 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-daeff039-a7ed-40e9-9e7c-3bffedd39ed6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:02.087234 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-daeff039-a7ed-40e9-9e7c-3bffedd39ed6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:02.087674 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-daeff039-a7ed-40e9-9e7c-3bffedd39ed6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:02.216978 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-daeff039-a7ed-40e9-9e7c-3bffedd39ed6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:02.225089 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-daeff039-a7ed-40e9-9e7c-3bffedd39ed6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.150185 Jun 22 09:18:02.225643 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 608/1261] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:02 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:03.242545 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9249bf76-6f8f-437f-8ee2-5f22308bdbb3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:03.243188 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9249bf76-6f8f-437f-8ee2-5f22308bdbb3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:03.250180 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9249bf76-6f8f-437f-8ee2-5f22308bdbb3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:03.250616 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9249bf76-6f8f-437f-8ee2-5f22308bdbb3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:03.251369 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9249bf76-6f8f-437f-8ee2-5f22308bdbb3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:03.251804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9249bf76-6f8f-437f-8ee2-5f22308bdbb3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:03.381168 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9249bf76-6f8f-437f-8ee2-5f22308bdbb3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:03.389237 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9249bf76-6f8f-437f-8ee2-5f22308bdbb3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.150471 Jun 22 09:18:03.389892 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 654/1262] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:03 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:04.407153 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-149500dd-41d5-4706-b16b-16834927c70b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:04.407769 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-149500dd-41d5-4706-b16b-16834927c70b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:04.414387 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-149500dd-41d5-4706-b16b-16834927c70b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:04.414841 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-149500dd-41d5-4706-b16b-16834927c70b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:04.415603 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-149500dd-41d5-4706-b16b-16834927c70b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:04.416044 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-149500dd-41d5-4706-b16b-16834927c70b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:04.542031 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-149500dd-41d5-4706-b16b-16834927c70b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:04.549941 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-149500dd-41d5-4706-b16b-16834927c70b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.147512 Jun 22 09:18:04.550501 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 609/1263] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:04 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:05.567471 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-044c6aba-3ea2-405d-83dc-7f2540a67fee tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:05.568351 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-044c6aba-3ea2-405d-83dc-7f2540a67fee tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:05.574874 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-044c6aba-3ea2-405d-83dc-7f2540a67fee tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:05.575315 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-044c6aba-3ea2-405d-83dc-7f2540a67fee tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:05.576067 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-044c6aba-3ea2-405d-83dc-7f2540a67fee tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:05.576500 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-044c6aba-3ea2-405d-83dc-7f2540a67fee tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:05.706974 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-044c6aba-3ea2-405d-83dc-7f2540a67fee tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:05.715263 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-044c6aba-3ea2-405d-83dc-7f2540a67fee tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.151635 Jun 22 09:18:05.715823 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 655/1264] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:05 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:06.731978 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-688e9e56-a227-4204-a572-a6734e38aa64 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:06.732604 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-688e9e56-a227-4204-a572-a6734e38aa64 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:06.740524 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-688e9e56-a227-4204-a572-a6734e38aa64 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:06.741022 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-688e9e56-a227-4204-a572-a6734e38aa64 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:06.741799 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-688e9e56-a227-4204-a572-a6734e38aa64 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:06.742240 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-688e9e56-a227-4204-a572-a6734e38aa64 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:06.870105 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-688e9e56-a227-4204-a572-a6734e38aa64 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:06.878380 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-688e9e56-a227-4204-a572-a6734e38aa64 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.150298 Jun 22 09:18:06.878989 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 610/1265] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:06 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:07.895652 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-4edee9a0-f011-4003-80d9-ff6a2cff714d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:07.896196 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-4edee9a0-f011-4003-80d9-ff6a2cff714d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:07.902708 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4edee9a0-f011-4003-80d9-ff6a2cff714d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:07.903168 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4edee9a0-f011-4003-80d9-ff6a2cff714d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:07.903932 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4edee9a0-f011-4003-80d9-ff6a2cff714d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:07.904376 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4edee9a0-f011-4003-80d9-ff6a2cff714d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:08.033010 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-4edee9a0-f011-4003-80d9-ff6a2cff714d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:08.041018 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-4edee9a0-f011-4003-80d9-ff6a2cff714d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149556 Jun 22 09:18:08.041580 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 656/1266] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:07 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:09.058251 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b618d674-6238-4e24-96b4-f5679b072434 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:09.058864 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-b618d674-6238-4e24-96b4-f5679b072434 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:09.065655 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b618d674-6238-4e24-96b4-f5679b072434 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:09.066098 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b618d674-6238-4e24-96b4-f5679b072434 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:09.066848 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b618d674-6238-4e24-96b4-f5679b072434 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:09.067286 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b618d674-6238-4e24-96b4-f5679b072434 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:09.194657 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-b618d674-6238-4e24-96b4-f5679b072434 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:09.203464 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-b618d674-6238-4e24-96b4-f5679b072434 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149282 Jun 22 09:18:09.204029 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 611/1267] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:09 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:10.221630 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9dcf5d07-7917-4924-9536-27c868d00242 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:10.222249 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9dcf5d07-7917-4924-9536-27c868d00242 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:10.228750 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9dcf5d07-7917-4924-9536-27c868d00242 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:10.229231 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9dcf5d07-7917-4924-9536-27c868d00242 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:10.229992 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9dcf5d07-7917-4924-9536-27c868d00242 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:10.230434 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9dcf5d07-7917-4924-9536-27c868d00242 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:10.358433 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9dcf5d07-7917-4924-9536-27c868d00242 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:10.366800 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9dcf5d07-7917-4924-9536-27c868d00242 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149227 Jun 22 09:18:10.367371 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 657/1268] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:10 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:11.384861 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-60dd6c7d-2042-4dae-a463-f312930e62ec tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:11.385400 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-60dd6c7d-2042-4dae-a463-f312930e62ec tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:11.392406 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-60dd6c7d-2042-4dae-a463-f312930e62ec tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:11.392918 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-60dd6c7d-2042-4dae-a463-f312930e62ec tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:11.393688 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-60dd6c7d-2042-4dae-a463-f312930e62ec tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:11.394131 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-60dd6c7d-2042-4dae-a463-f312930e62ec tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:11.523830 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-60dd6c7d-2042-4dae-a463-f312930e62ec tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:11.532919 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-60dd6c7d-2042-4dae-a463-f312930e62ec tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.152092 Jun 22 09:18:11.533485 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 612/1269] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:11 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:12.549770 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-ad72c2c7-10af-480f-9da5-23ef8ee596dc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:12.550388 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-ad72c2c7-10af-480f-9da5-23ef8ee596dc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:12.552895 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=42 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:18:12.557621 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ad72c2c7-10af-480f-9da5-23ef8ee596dc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:12.558075 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ad72c2c7-10af-480f-9da5-23ef8ee596dc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:12.558841 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ad72c2c7-10af-480f-9da5-23ef8ee596dc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:12.559281 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ad72c2c7-10af-480f-9da5-23ef8ee596dc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:12.690152 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-ad72c2c7-10af-480f-9da5-23ef8ee596dc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:12.698137 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-ad72c2c7-10af-480f-9da5-23ef8ee596dc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.153087 Jun 22 09:18:12.698701 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 658/1270] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:12 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:13.714993 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-723c251e-c560-4c92-b041-95769cbcc408 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:13.715583 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-723c251e-c560-4c92-b041-95769cbcc408 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:13.722152 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-723c251e-c560-4c92-b041-95769cbcc408 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:13.722595 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-723c251e-c560-4c92-b041-95769cbcc408 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:13.723348 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-723c251e-c560-4c92-b041-95769cbcc408 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:13.723781 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-723c251e-c560-4c92-b041-95769cbcc408 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:13.852219 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-723c251e-c560-4c92-b041-95769cbcc408 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:13.860650 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-723c251e-c560-4c92-b041-95769cbcc408 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149472 Jun 22 09:18:13.861422 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 613/1271] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:13 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:14.878366 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-02846100-2606-469e-a0d4-06892a8cf3c8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:14.878979 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-02846100-2606-469e-a0d4-06892a8cf3c8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:14.885505 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-02846100-2606-469e-a0d4-06892a8cf3c8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:14.885953 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-02846100-2606-469e-a0d4-06892a8cf3c8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:14.886712 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-02846100-2606-469e-a0d4-06892a8cf3c8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:14.887143 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-02846100-2606-469e-a0d4-06892a8cf3c8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:14.889706 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=100 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:18:15.023563 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-02846100-2606-469e-a0d4-06892a8cf3c8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:15.031773 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-02846100-2606-469e-a0d4-06892a8cf3c8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.157925 Jun 22 09:18:15.032445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 659/1272] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:14 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:16.049792 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-34ded9e7-0230-4d02-bd85-8d52070f572f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:16.050407 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-34ded9e7-0230-4d02-bd85-8d52070f572f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:16.057123 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-34ded9e7-0230-4d02-bd85-8d52070f572f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:16.057570 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-34ded9e7-0230-4d02-bd85-8d52070f572f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:16.058332 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-34ded9e7-0230-4d02-bd85-8d52070f572f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:16.058769 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-34ded9e7-0230-4d02-bd85-8d52070f572f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:16.185391 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-34ded9e7-0230-4d02-bd85-8d52070f572f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:16.193985 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-34ded9e7-0230-4d02-bd85-8d52070f572f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.148902 Jun 22 09:18:16.194551 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 614/1273] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:16 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:17.210467 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c83bd516-cab8-40ce-84b7-2ce9ca239002 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:17.211077 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c83bd516-cab8-40ce-84b7-2ce9ca239002 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:17.217840 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c83bd516-cab8-40ce-84b7-2ce9ca239002 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:17.218293 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c83bd516-cab8-40ce-84b7-2ce9ca239002 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:17.219111 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c83bd516-cab8-40ce-84b7-2ce9ca239002 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:17.219551 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c83bd516-cab8-40ce-84b7-2ce9ca239002 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:17.351521 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c83bd516-cab8-40ce-84b7-2ce9ca239002 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:17.363363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c83bd516-cab8-40ce-84b7-2ce9ca239002 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.156702 Jun 22 09:18:17.363938 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 660/1274] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:17 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:18.380159 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-9b3cfebf-726d-4b80-aedb-9d73d51bcdde tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:18.380698 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-9b3cfebf-726d-4b80-aedb-9d73d51bcdde tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:18.387247 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9b3cfebf-726d-4b80-aedb-9d73d51bcdde tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:18.387701 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9b3cfebf-726d-4b80-aedb-9d73d51bcdde tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:18.388455 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9b3cfebf-726d-4b80-aedb-9d73d51bcdde tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:18.388924 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9b3cfebf-726d-4b80-aedb-9d73d51bcdde tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:18.518510 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-9b3cfebf-726d-4b80-aedb-9d73d51bcdde tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:18.526916 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-9b3cfebf-726d-4b80-aedb-9d73d51bcdde tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.151298 Jun 22 09:18:18.527479 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 615/1275] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:18 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:19.181491 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:18:19.181927 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Wed Jun 22 09:18:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:18:19.543142 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d90e1d52-1e58-4f9c-a5a1-8114309a6e26 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:19.543752 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-d90e1d52-1e58-4f9c-a5a1-8114309a6e26 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:19.550358 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d90e1d52-1e58-4f9c-a5a1-8114309a6e26 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:19.550800 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d90e1d52-1e58-4f9c-a5a1-8114309a6e26 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:19.551551 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d90e1d52-1e58-4f9c-a5a1-8114309a6e26 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:19.551985 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d90e1d52-1e58-4f9c-a5a1-8114309a6e26 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:19.682448 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-d90e1d52-1e58-4f9c-a5a1-8114309a6e26 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:19.694585 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d90e1d52-1e58-4f9c-a5a1-8114309a6e26 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.155192 Jun 22 09:18:19.695138 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 661/1276] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:19 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:20.712026 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-fac8a698-9a49-4bf2-889e-4312eb5fed17 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:20.712705 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-fac8a698-9a49-4bf2-889e-4312eb5fed17 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:20.719188 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fac8a698-9a49-4bf2-889e-4312eb5fed17 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:20.719635 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fac8a698-9a49-4bf2-889e-4312eb5fed17 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:20.720388 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fac8a698-9a49-4bf2-889e-4312eb5fed17 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:20.721487 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fac8a698-9a49-4bf2-889e-4312eb5fed17 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:20.847764 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-fac8a698-9a49-4bf2-889e-4312eb5fed17 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:20.855694 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-fac8a698-9a49-4bf2-889e-4312eb5fed17 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.147687 Jun 22 09:18:20.856254 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 616/1277] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:20 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:21.874143 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d2bd76eb-377e-48f6-9750-1793b8a081ae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:21.874681 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-d2bd76eb-377e-48f6-9750-1793b8a081ae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:21.880894 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d2bd76eb-377e-48f6-9750-1793b8a081ae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:21.881345 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d2bd76eb-377e-48f6-9750-1793b8a081ae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:21.882104 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d2bd76eb-377e-48f6-9750-1793b8a081ae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:21.882550 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d2bd76eb-377e-48f6-9750-1793b8a081ae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:22.008223 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-d2bd76eb-377e-48f6-9750-1793b8a081ae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:22.016168 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d2bd76eb-377e-48f6-9750-1793b8a081ae tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.146133 Jun 22 09:18:22.016727 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 662/1278] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:21 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:23.034914 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ee8c3d76-e502-40fc-8dfb-84b5e4f3ce5d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:23.035552 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ee8c3d76-e502-40fc-8dfb-84b5e4f3ce5d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:23.038010 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=36 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:18:23.042684 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ee8c3d76-e502-40fc-8dfb-84b5e4f3ce5d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:23.043125 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ee8c3d76-e502-40fc-8dfb-84b5e4f3ce5d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:23.043874 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ee8c3d76-e502-40fc-8dfb-84b5e4f3ce5d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:23.044305 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ee8c3d76-e502-40fc-8dfb-84b5e4f3ce5d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:23.175093 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ee8c3d76-e502-40fc-8dfb-84b5e4f3ce5d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:23.183330 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ee8c3d76-e502-40fc-8dfb-84b5e4f3ce5d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.152889 Jun 22 09:18:23.183898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 617/1279] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:23 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:24.201058 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-001d48c9-5825-4b86-a9fb-2c45bcdbdce7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:24.201711 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-001d48c9-5825-4b86-a9fb-2c45bcdbdce7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:24.208332 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-001d48c9-5825-4b86-a9fb-2c45bcdbdce7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:24.208805 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-001d48c9-5825-4b86-a9fb-2c45bcdbdce7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:24.209598 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-001d48c9-5825-4b86-a9fb-2c45bcdbdce7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:24.210067 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-001d48c9-5825-4b86-a9fb-2c45bcdbdce7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:24.336797 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-001d48c9-5825-4b86-a9fb-2c45bcdbdce7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:24.344695 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-001d48c9-5825-4b86-a9fb-2c45bcdbdce7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.147590 Jun 22 09:18:24.345284 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 663/1280] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:24 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:18:25.361811 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-34641ace-153e-4995-ae51-49e84d76c519 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:25.362451 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-34641ace-153e-4995-ae51-49e84d76c519 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:25.369661 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-34641ace-153e-4995-ae51-49e84d76c519 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:25.370105 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-34641ace-153e-4995-ae51-49e84d76c519 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:25.370854 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-34641ace-153e-4995-ae51-49e84d76c519 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:25.371282 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-34641ace-153e-4995-ae51-49e84d76c519 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:25.375140 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=84 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:18:25.509943 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-34641ace-153e-4995-ae51-49e84d76c519 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:25.518121 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-34641ace-153e-4995-ae51-49e84d76c519 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.160217 Jun 22 09:18:25.518939 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 618/1281] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:25 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:26.535399 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-eaad67f9-48de-40f5-a5a2-222b11720852 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:26.536002 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-eaad67f9-48de-40f5-a5a2-222b11720852 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:26.542449 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eaad67f9-48de-40f5-a5a2-222b11720852 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:26.542894 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eaad67f9-48de-40f5-a5a2-222b11720852 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:26.543643 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eaad67f9-48de-40f5-a5a2-222b11720852 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:26.544080 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eaad67f9-48de-40f5-a5a2-222b11720852 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:26.670117 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-eaad67f9-48de-40f5-a5a2-222b11720852 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:26.678567 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-eaad67f9-48de-40f5-a5a2-222b11720852 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.147203 Jun 22 09:18:26.679130 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 664/1282] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:26 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:27.695378 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-cb80c4c4-d40b-4c9e-8b0e-1312d1582070 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:27.695979 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-cb80c4c4-d40b-4c9e-8b0e-1312d1582070 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:27.702547 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cb80c4c4-d40b-4c9e-8b0e-1312d1582070 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:27.702996 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cb80c4c4-d40b-4c9e-8b0e-1312d1582070 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:27.703748 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cb80c4c4-d40b-4c9e-8b0e-1312d1582070 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:27.704179 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cb80c4c4-d40b-4c9e-8b0e-1312d1582070 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:27.828277 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-cb80c4c4-d40b-4c9e-8b0e-1312d1582070 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:27.837346 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-cb80c4c4-d40b-4c9e-8b0e-1312d1582070 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.146446 Jun 22 09:18:27.837944 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 619/1283] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:27 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:28.854267 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-4564fda2-93cb-420d-b797-d443459c877a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:28.854836 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-4564fda2-93cb-420d-b797-d443459c877a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:28.861508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4564fda2-93cb-420d-b797-d443459c877a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:28.861954 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4564fda2-93cb-420d-b797-d443459c877a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:28.862789 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4564fda2-93cb-420d-b797-d443459c877a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:28.863228 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4564fda2-93cb-420d-b797-d443459c877a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:28.996233 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-4564fda2-93cb-420d-b797-d443459c877a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:29.014569 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-4564fda2-93cb-420d-b797-d443459c877a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.154718 Jun 22 09:18:29.014569 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 665/1284] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:28 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:30.028943 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b8790830-8878-4114-8025-a8bf7450814f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:30.029568 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-b8790830-8878-4114-8025-a8bf7450814f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:30.037595 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b8790830-8878-4114-8025-a8bf7450814f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:30.038073 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b8790830-8878-4114-8025-a8bf7450814f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:30.038885 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b8790830-8878-4114-8025-a8bf7450814f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:30.039326 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b8790830-8878-4114-8025-a8bf7450814f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:30.176596 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-b8790830-8878-4114-8025-a8bf7450814f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:30.184517 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-b8790830-8878-4114-8025-a8bf7450814f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.159719 Jun 22 09:18:30.185121 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 620/1285] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:30 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:31.201340 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-3133e49e-bfce-4274-8653-e5dd220d9e5d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:31.201756 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-3133e49e-bfce-4274-8653-e5dd220d9e5d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:31.208381 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3133e49e-bfce-4274-8653-e5dd220d9e5d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:31.208861 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3133e49e-bfce-4274-8653-e5dd220d9e5d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:31.213048 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3133e49e-bfce-4274-8653-e5dd220d9e5d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:31.213048 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3133e49e-bfce-4274-8653-e5dd220d9e5d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:31.342633 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-3133e49e-bfce-4274-8653-e5dd220d9e5d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:31.351492 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-3133e49e-bfce-4274-8653-e5dd220d9e5d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.154653 Jun 22 09:18:31.352059 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 666/1286] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:31 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:32.368016 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-e0150acf-0c11-4008-b47d-c68930df60ce tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:32.368547 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-e0150acf-0c11-4008-b47d-c68930df60ce tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:32.374980 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e0150acf-0c11-4008-b47d-c68930df60ce tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:32.375424 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e0150acf-0c11-4008-b47d-c68930df60ce tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:32.376175 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e0150acf-0c11-4008-b47d-c68930df60ce tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:32.376607 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e0150acf-0c11-4008-b47d-c68930df60ce tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:32.502345 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-e0150acf-0c11-4008-b47d-c68930df60ce tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:32.510754 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-e0150acf-0c11-4008-b47d-c68930df60ce tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.146657 Jun 22 09:18:32.511309 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 621/1287] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:32 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:33.528654 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e3e28399-e776-4743-8b15-bcac17807043 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:33.529239 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e3e28399-e776-4743-8b15-bcac17807043 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:33.535817 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e3e28399-e776-4743-8b15-bcac17807043 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:33.536258 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e3e28399-e776-4743-8b15-bcac17807043 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:33.537048 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e3e28399-e776-4743-8b15-bcac17807043 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:33.537483 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e3e28399-e776-4743-8b15-bcac17807043 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:33.666527 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-e3e28399-e776-4743-8b15-bcac17807043 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:33.674443 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e3e28399-e776-4743-8b15-bcac17807043 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149685 Jun 22 09:18:33.675302 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 667/1288] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:33 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:34.692366 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-233d64b5-b875-41f7-880d-03e1b73cb1d8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:34.693029 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-233d64b5-b875-41f7-880d-03e1b73cb1d8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:34.699509 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-233d64b5-b875-41f7-880d-03e1b73cb1d8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:34.699954 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-233d64b5-b875-41f7-880d-03e1b73cb1d8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:34.700717 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-233d64b5-b875-41f7-880d-03e1b73cb1d8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:34.701175 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-233d64b5-b875-41f7-880d-03e1b73cb1d8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:34.826541 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-233d64b5-b875-41f7-880d-03e1b73cb1d8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:34.834571 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-233d64b5-b875-41f7-880d-03e1b73cb1d8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.146746 Jun 22 09:18:34.835126 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 622/1289] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:34 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:35.851519 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-3eb224a5-c82f-4488-a16b-325458009f75 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:35.852155 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-3eb224a5-c82f-4488-a16b-325458009f75 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:35.858733 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3eb224a5-c82f-4488-a16b-325458009f75 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:35.859181 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3eb224a5-c82f-4488-a16b-325458009f75 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:35.859937 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3eb224a5-c82f-4488-a16b-325458009f75 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:35.860370 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3eb224a5-c82f-4488-a16b-325458009f75 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:35.988595 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-3eb224a5-c82f-4488-a16b-325458009f75 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:35.996684 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-3eb224a5-c82f-4488-a16b-325458009f75 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.148993 Jun 22 09:18:35.997469 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 668/1290] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:35 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:37.014895 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-0253edfb-04bc-4130-b5fb-f51035682ca3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:37.015495 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-0253edfb-04bc-4130-b5fb-f51035682ca3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:37.023198 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0253edfb-04bc-4130-b5fb-f51035682ca3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:37.023647 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0253edfb-04bc-4130-b5fb-f51035682ca3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:37.024402 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0253edfb-04bc-4130-b5fb-f51035682ca3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:37.024865 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0253edfb-04bc-4130-b5fb-f51035682ca3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:37.156292 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-0253edfb-04bc-4130-b5fb-f51035682ca3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:37.165509 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-0253edfb-04bc-4130-b5fb-f51035682ca3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.154627 Jun 22 09:18:37.166075 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 623/1291] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:37 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:38.183392 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-1dd3ec7e-4892-4290-8d83-f568399d3831 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:38.183997 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-1dd3ec7e-4892-4290-8d83-f568399d3831 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:38.190984 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1dd3ec7e-4892-4290-8d83-f568399d3831 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:38.191432 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1dd3ec7e-4892-4290-8d83-f568399d3831 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:38.192188 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1dd3ec7e-4892-4290-8d83-f568399d3831 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:38.192616 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1dd3ec7e-4892-4290-8d83-f568399d3831 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:38.318690 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-1dd3ec7e-4892-4290-8d83-f568399d3831 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:38.326666 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-1dd3ec7e-4892-4290-8d83-f568399d3831 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.147175 Jun 22 09:18:38.327223 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 669/1292] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:38 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:18:39.344213 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a3779dc8-a8d5-46df-ad5c-e59139cc5465 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:39.347007 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a3779dc8-a8d5-46df-ad5c-e59139cc5465 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:39.351834 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a3779dc8-a8d5-46df-ad5c-e59139cc5465 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:39.352282 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a3779dc8-a8d5-46df-ad5c-e59139cc5465 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:39.353066 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a3779dc8-a8d5-46df-ad5c-e59139cc5465 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:39.353498 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a3779dc8-a8d5-46df-ad5c-e59139cc5465 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:39.482665 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-a3779dc8-a8d5-46df-ad5c-e59139cc5465 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:39.490625 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a3779dc8-a8d5-46df-ad5c-e59139cc5465 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.150314 Jun 22 09:18:39.491193 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 624/1293] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:39 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:40.507596 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-76884146-006d-4616-92b1-acc9f353a909 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:40.508134 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-76884146-006d-4616-92b1-acc9f353a909 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:40.514680 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-76884146-006d-4616-92b1-acc9f353a909 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:40.515133 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-76884146-006d-4616-92b1-acc9f353a909 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:40.515921 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-76884146-006d-4616-92b1-acc9f353a909 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:40.516353 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-76884146-006d-4616-92b1-acc9f353a909 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:40.647920 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-76884146-006d-4616-92b1-acc9f353a909 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:40.655924 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-76884146-006d-4616-92b1-acc9f353a909 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.152232 Jun 22 09:18:40.656481 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 670/1294] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:40 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:41.672881 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-96d77ee7-eca0-4680-b5bc-b7326b041f1c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:41.673502 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-96d77ee7-eca0-4680-b5bc-b7326b041f1c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:41.680613 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-96d77ee7-eca0-4680-b5bc-b7326b041f1c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:41.681098 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-96d77ee7-eca0-4680-b5bc-b7326b041f1c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:41.681865 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-96d77ee7-eca0-4680-b5bc-b7326b041f1c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:41.682307 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-96d77ee7-eca0-4680-b5bc-b7326b041f1c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:41.810060 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-96d77ee7-eca0-4680-b5bc-b7326b041f1c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:41.818929 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-96d77ee7-eca0-4680-b5bc-b7326b041f1c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149923 Jun 22 09:18:41.819488 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 625/1295] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:41 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:42.836074 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f106f32d-ee26-41de-8e9f-63c3e37f3e7c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:42.836676 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-f106f32d-ee26-41de-8e9f-63c3e37f3e7c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:42.839049 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=26 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:18:42.843805 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f106f32d-ee26-41de-8e9f-63c3e37f3e7c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:42.850434 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f106f32d-ee26-41de-8e9f-63c3e37f3e7c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:42.850434 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f106f32d-ee26-41de-8e9f-63c3e37f3e7c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:42.850434 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f106f32d-ee26-41de-8e9f-63c3e37f3e7c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:42.976679 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-f106f32d-ee26-41de-8e9f-63c3e37f3e7c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:42.984684 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f106f32d-ee26-41de-8e9f-63c3e37f3e7c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.152527 Jun 22 09:18:42.985268 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 671/1296] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:42 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:44.003679 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-67080d41-ae96-4c08-a030-e1c748fa5358 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:44.004264 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-67080d41-ae96-4c08-a030-e1c748fa5358 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:44.010934 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-67080d41-ae96-4c08-a030-e1c748fa5358 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:44.011389 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-67080d41-ae96-4c08-a030-e1c748fa5358 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:44.012224 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-67080d41-ae96-4c08-a030-e1c748fa5358 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:44.012696 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-67080d41-ae96-4c08-a030-e1c748fa5358 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:44.143799 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-67080d41-ae96-4c08-a030-e1c748fa5358 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:44.152053 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-67080d41-ae96-4c08-a030-e1c748fa5358 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.153521 Jun 22 09:18:44.152611 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 626/1297] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:43 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:45.169610 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-36fd495d-fb0d-4806-a0c2-94fd47d3aa18 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:45.170242 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-36fd495d-fb0d-4806-a0c2-94fd47d3aa18 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:45.177339 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-36fd495d-fb0d-4806-a0c2-94fd47d3aa18 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:45.177784 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-36fd495d-fb0d-4806-a0c2-94fd47d3aa18 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:45.178536 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-36fd495d-fb0d-4806-a0c2-94fd47d3aa18 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:45.178967 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-36fd495d-fb0d-4806-a0c2-94fd47d3aa18 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:45.182852 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=78 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:18:45.318876 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-36fd495d-fb0d-4806-a0c2-94fd47d3aa18 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:45.326878 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-36fd495d-fb0d-4806-a0c2-94fd47d3aa18 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.161094 Jun 22 09:18:45.327621 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 672/1298] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:45 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:46.344790 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c3e7b120-3b6f-4329-a64b-3324ebda58f6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:46.345399 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c3e7b120-3b6f-4329-a64b-3324ebda58f6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:46.351881 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c3e7b120-3b6f-4329-a64b-3324ebda58f6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:46.352323 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c3e7b120-3b6f-4329-a64b-3324ebda58f6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:46.353108 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c3e7b120-3b6f-4329-a64b-3324ebda58f6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:46.353542 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c3e7b120-3b6f-4329-a64b-3324ebda58f6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:46.483090 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-c3e7b120-3b6f-4329-a64b-3324ebda58f6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:46.491026 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c3e7b120-3b6f-4329-a64b-3324ebda58f6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.150171 Jun 22 09:18:46.491587 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 627/1299] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:46 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:47.508520 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-0adf0079-2275-479b-9aec-5078aeb75bcc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:47.509159 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-0adf0079-2275-479b-9aec-5078aeb75bcc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:47.515673 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0adf0079-2275-479b-9aec-5078aeb75bcc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:47.516125 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0adf0079-2275-479b-9aec-5078aeb75bcc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:47.516914 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0adf0079-2275-479b-9aec-5078aeb75bcc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:47.517352 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0adf0079-2275-479b-9aec-5078aeb75bcc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:47.646133 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-0adf0079-2275-479b-9aec-5078aeb75bcc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:47.654078 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-0adf0079-2275-479b-9aec-5078aeb75bcc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149477 Jun 22 09:18:47.654639 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 673/1300] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:47 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:48.671411 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-50094ca7-ce12-4545-9226-31a637f6aa87 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:48.672016 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-50094ca7-ce12-4545-9226-31a637f6aa87 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:48.679101 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-50094ca7-ce12-4545-9226-31a637f6aa87 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:48.679545 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-50094ca7-ce12-4545-9226-31a637f6aa87 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:48.680293 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-50094ca7-ce12-4545-9226-31a637f6aa87 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:48.680725 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-50094ca7-ce12-4545-9226-31a637f6aa87 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:48.809159 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-50094ca7-ce12-4545-9226-31a637f6aa87 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:48.817430 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-50094ca7-ce12-4545-9226-31a637f6aa87 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149968 Jun 22 09:18:48.817997 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 628/1301] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:48 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:49.350506 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f8c8dcd5-3687-4411-8474-14c005efb504 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:49.351065 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-f8c8dcd5-3687-4411-8474-14c005efb504 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: 46fa6d8c-afd7-4385-a727-ee8d14223669] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:49.357051 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f8c8dcd5-3687-4411-8474-14c005efb504 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:49.357497 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f8c8dcd5-3687-4411-8474-14c005efb504 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:49.358246 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f8c8dcd5-3687-4411-8474-14c005efb504 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:49.358676 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f8c8dcd5-3687-4411-8474-14c005efb504 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:49.381933 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f8c8dcd5-3687-4411-8474-14c005efb504 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669/ips" status: 200 len: 149 microversion: 2.1 time: 0.104475 Jun 22 09:18:49.382466 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 674/1302] 10.222.0.16 () {58 vars in 1247 bytes} [Wed Jun 22 09:18:49 2022] GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669/ips => generated 149 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:18:49.834526 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-86f23420-99e0-4757-a8ee-b10aad9cddaa tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:49.835282 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-86f23420-99e0-4757-a8ee-b10aad9cddaa tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:49.841838 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-86f23420-99e0-4757-a8ee-b10aad9cddaa tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:49.842288 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-86f23420-99e0-4757-a8ee-b10aad9cddaa tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:49.843051 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-86f23420-99e0-4757-a8ee-b10aad9cddaa tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:49.843488 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-86f23420-99e0-4757-a8ee-b10aad9cddaa tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:49.981001 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-86f23420-99e0-4757-a8ee-b10aad9cddaa tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:49.990015 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-86f23420-99e0-4757-a8ee-b10aad9cddaa tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.159469 Jun 22 09:18:49.990599 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 629/1303] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:49 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:51.007421 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-3c189996-9797-4fbe-b667-71b8aefdd65b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:51.008056 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-3c189996-9797-4fbe-b667-71b8aefdd65b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:51.014575 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3c189996-9797-4fbe-b667-71b8aefdd65b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:51.015027 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3c189996-9797-4fbe-b667-71b8aefdd65b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:51.015790 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3c189996-9797-4fbe-b667-71b8aefdd65b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:51.016523 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3c189996-9797-4fbe-b667-71b8aefdd65b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:51.155673 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-3c189996-9797-4fbe-b667-71b8aefdd65b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:51.163819 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-3c189996-9797-4fbe-b667-71b8aefdd65b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.160280 Jun 22 09:18:51.164374 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 675/1304] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:51 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:52.181094 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6e50fb3e-555b-4f18-bac6-fad832a1ad10 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:52.181705 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-6e50fb3e-555b-4f18-bac6-fad832a1ad10 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:52.188235 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6e50fb3e-555b-4f18-bac6-fad832a1ad10 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:52.188681 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6e50fb3e-555b-4f18-bac6-fad832a1ad10 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:52.189652 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6e50fb3e-555b-4f18-bac6-fad832a1ad10 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:52.190108 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6e50fb3e-555b-4f18-bac6-fad832a1ad10 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:52.317435 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-6e50fb3e-555b-4f18-bac6-fad832a1ad10 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:52.325413 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-6e50fb3e-555b-4f18-bac6-fad832a1ad10 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.148135 Jun 22 09:18:52.325981 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 630/1305] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:52 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:53.342834 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-5d69738b-0fa7-4630-97ad-0c45c45d05cb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:53.343454 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-5d69738b-0fa7-4630-97ad-0c45c45d05cb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:53.349955 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5d69738b-0fa7-4630-97ad-0c45c45d05cb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:53.350406 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5d69738b-0fa7-4630-97ad-0c45c45d05cb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:53.351165 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5d69738b-0fa7-4630-97ad-0c45c45d05cb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:53.351605 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5d69738b-0fa7-4630-97ad-0c45c45d05cb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:53.478863 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-5d69738b-0fa7-4630-97ad-0c45c45d05cb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:53.487786 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-5d69738b-0fa7-4630-97ad-0c45c45d05cb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.148840 Jun 22 09:18:53.488351 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 676/1306] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:53 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:54.505453 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-10812f03-3dfa-4389-b91c-4dc195d96eac tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:54.505987 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-10812f03-3dfa-4389-b91c-4dc195d96eac tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:54.508276 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=28 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:18:54.513049 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-10812f03-3dfa-4389-b91c-4dc195d96eac tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:54.513498 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-10812f03-3dfa-4389-b91c-4dc195d96eac tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:54.514263 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-10812f03-3dfa-4389-b91c-4dc195d96eac tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:54.514700 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-10812f03-3dfa-4389-b91c-4dc195d96eac tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:54.640875 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-10812f03-3dfa-4389-b91c-4dc195d96eac tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:54.649729 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-10812f03-3dfa-4389-b91c-4dc195d96eac tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.148911 Jun 22 09:18:54.650309 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 631/1307] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:54 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:55.666488 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-74eb3d07-bf4d-42b7-a65b-5169a7f2f0f5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:55.667116 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-74eb3d07-bf4d-42b7-a65b-5169a7f2f0f5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:55.673726 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-74eb3d07-bf4d-42b7-a65b-5169a7f2f0f5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:55.674174 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-74eb3d07-bf4d-42b7-a65b-5169a7f2f0f5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:55.674939 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-74eb3d07-bf4d-42b7-a65b-5169a7f2f0f5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:55.675380 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-74eb3d07-bf4d-42b7-a65b-5169a7f2f0f5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:55.800357 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-74eb3d07-bf4d-42b7-a65b-5169a7f2f0f5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:55.808317 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-74eb3d07-bf4d-42b7-a65b-5169a7f2f0f5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.145677 Jun 22 09:18:55.808887 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 677/1308] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:55 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:56.825433 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ee82f8ba-53f1-470f-a135-e3c9399ad57b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:56.826076 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ee82f8ba-53f1-470f-a135-e3c9399ad57b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:56.833048 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ee82f8ba-53f1-470f-a135-e3c9399ad57b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:56.833499 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ee82f8ba-53f1-470f-a135-e3c9399ad57b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:56.834262 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ee82f8ba-53f1-470f-a135-e3c9399ad57b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:56.834701 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ee82f8ba-53f1-470f-a135-e3c9399ad57b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:56.838605 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=84 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:18:56.964733 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ee82f8ba-53f1-470f-a135-e3c9399ad57b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:56.975010 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ee82f8ba-53f1-470f-a135-e3c9399ad57b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.153413 Jun 22 09:18:56.975931 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 632/1309] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:56 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:57.992834 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-ac091aa2-617f-46b7-ba57-c599871d1c7b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:57.993464 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-ac091aa2-617f-46b7-ba57-c599871d1c7b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:57.999960 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ac091aa2-617f-46b7-ba57-c599871d1c7b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:58.000408 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ac091aa2-617f-46b7-ba57-c599871d1c7b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:58.001183 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ac091aa2-617f-46b7-ba57-c599871d1c7b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:58.002493 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ac091aa2-617f-46b7-ba57-c599871d1c7b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:58.126181 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-ac091aa2-617f-46b7-ba57-c599871d1c7b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:58.134676 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-ac091aa2-617f-46b7-ba57-c599871d1c7b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.145736 Jun 22 09:18:58.135227 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 678/1310] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:57 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:59.151098 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ea14a5df-0425-44a4-916b-bba9ffb9302e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:59.151716 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ea14a5df-0425-44a4-916b-bba9ffb9302e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:59.158436 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ea14a5df-0425-44a4-916b-bba9ffb9302e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:59.158888 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ea14a5df-0425-44a4-916b-bba9ffb9302e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:59.159653 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ea14a5df-0425-44a4-916b-bba9ffb9302e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:59.160093 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ea14a5df-0425-44a4-916b-bba9ffb9302e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:59.297411 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ea14a5df-0425-44a4-916b-bba9ffb9302e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:59.305490 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ea14a5df-0425-44a4-916b-bba9ffb9302e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.158268 Jun 22 09:18:59.305988 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 633/1311] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:59 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:00.323572 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-4569788d-1c92-4c02-9999-fabc66b69981 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:00.324179 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-4569788d-1c92-4c02-9999-fabc66b69981 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:00.330702 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4569788d-1c92-4c02-9999-fabc66b69981 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:00.331172 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4569788d-1c92-4c02-9999-fabc66b69981 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:00.331921 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4569788d-1c92-4c02-9999-fabc66b69981 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:00.332359 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4569788d-1c92-4c02-9999-fabc66b69981 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:00.464938 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-4569788d-1c92-4c02-9999-fabc66b69981 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:00.473038 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-4569788d-1c92-4c02-9999-fabc66b69981 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.153326 Jun 22 09:19:00.473592 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 679/1312] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:00 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:01.488898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-49a35fde-7e7f-43cb-ade0-ab81fce8ccdd tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:01.489507 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-49a35fde-7e7f-43cb-ade0-ab81fce8ccdd tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:01.496006 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-49a35fde-7e7f-43cb-ade0-ab81fce8ccdd tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:01.496451 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-49a35fde-7e7f-43cb-ade0-ab81fce8ccdd tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:01.497228 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-49a35fde-7e7f-43cb-ade0-ab81fce8ccdd tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:01.497661 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-49a35fde-7e7f-43cb-ade0-ab81fce8ccdd tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:01.625901 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-49a35fde-7e7f-43cb-ade0-ab81fce8ccdd tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:01.634609 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-49a35fde-7e7f-43cb-ade0-ab81fce8ccdd tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149506 Jun 22 09:19:01.635174 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 634/1313] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:01 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:02.651948 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-6b464a38-dd99-4fcd-ae6f-3c2a088c2f44 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:02.652565 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-6b464a38-dd99-4fcd-ae6f-3c2a088c2f44 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:02.660224 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6b464a38-dd99-4fcd-ae6f-3c2a088c2f44 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:02.662016 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6b464a38-dd99-4fcd-ae6f-3c2a088c2f44 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:02.662016 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6b464a38-dd99-4fcd-ae6f-3c2a088c2f44 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:02.662016 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6b464a38-dd99-4fcd-ae6f-3c2a088c2f44 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:02.794204 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-6b464a38-dd99-4fcd-ae6f-3c2a088c2f44 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:02.802213 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-6b464a38-dd99-4fcd-ae6f-3c2a088c2f44 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.154468 Jun 22 09:19:02.802807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 680/1314] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:02 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:03.818905 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-583b6fca-c09f-43f2-8d09-18904d92800c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:03.819573 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-583b6fca-c09f-43f2-8d09-18904d92800c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:03.826019 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-583b6fca-c09f-43f2-8d09-18904d92800c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:03.826504 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-583b6fca-c09f-43f2-8d09-18904d92800c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:03.827270 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-583b6fca-c09f-43f2-8d09-18904d92800c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:03.827708 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-583b6fca-c09f-43f2-8d09-18904d92800c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:03.951996 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-583b6fca-c09f-43f2-8d09-18904d92800c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:03.960493 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-583b6fca-c09f-43f2-8d09-18904d92800c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.145403 Jun 22 09:19:03.961082 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 635/1315] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:03 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:04.977445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f2e2796b-6fe6-49d1-98b2-938b0fe743f1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:04.978064 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-f2e2796b-6fe6-49d1-98b2-938b0fe743f1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:04.984591 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f2e2796b-6fe6-49d1-98b2-938b0fe743f1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:04.985076 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f2e2796b-6fe6-49d1-98b2-938b0fe743f1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:04.986357 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f2e2796b-6fe6-49d1-98b2-938b0fe743f1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:04.986796 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f2e2796b-6fe6-49d1-98b2-938b0fe743f1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:05.118824 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-f2e2796b-6fe6-49d1-98b2-938b0fe743f1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:05.127201 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f2e2796b-6fe6-49d1-98b2-938b0fe743f1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.153657 Jun 22 09:19:05.127770 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 681/1316] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:04 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:06.145928 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-cec53878-a081-40c8-8dfa-c9b78a4b6af8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:06.146495 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-cec53878-a081-40c8-8dfa-c9b78a4b6af8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:06.152873 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cec53878-a081-40c8-8dfa-c9b78a4b6af8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:06.153330 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cec53878-a081-40c8-8dfa-c9b78a4b6af8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:06.154074 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cec53878-a081-40c8-8dfa-c9b78a4b6af8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:06.154505 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cec53878-a081-40c8-8dfa-c9b78a4b6af8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:06.284252 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-cec53878-a081-40c8-8dfa-c9b78a4b6af8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:06.292466 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-cec53878-a081-40c8-8dfa-c9b78a4b6af8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.151622 Jun 22 09:19:06.293067 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 636/1317] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:06 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:07.309963 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-1914a8b3-c61a-44c4-a703-19691bf414ed tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:07.310606 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-1914a8b3-c61a-44c4-a703-19691bf414ed tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:07.317840 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1914a8b3-c61a-44c4-a703-19691bf414ed tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:07.318301 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1914a8b3-c61a-44c4-a703-19691bf414ed tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:07.319066 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1914a8b3-c61a-44c4-a703-19691bf414ed tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:07.319510 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1914a8b3-c61a-44c4-a703-19691bf414ed tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:07.448661 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-1914a8b3-c61a-44c4-a703-19691bf414ed tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:07.456600 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-1914a8b3-c61a-44c4-a703-19691bf414ed tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.150546 Jun 22 09:19:07.457132 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 682/1318] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:07 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:08.473618 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-2f123727-fa32-4d6d-bcb9-5f5d5d71957d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:08.474231 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-2f123727-fa32-4d6d-bcb9-5f5d5d71957d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:08.480917 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2f123727-fa32-4d6d-bcb9-5f5d5d71957d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:08.481368 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2f123727-fa32-4d6d-bcb9-5f5d5d71957d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:08.482124 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2f123727-fa32-4d6d-bcb9-5f5d5d71957d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:08.482562 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2f123727-fa32-4d6d-bcb9-5f5d5d71957d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:08.606236 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-2f123727-fa32-4d6d-bcb9-5f5d5d71957d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:08.614698 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-2f123727-fa32-4d6d-bcb9-5f5d5d71957d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.145041 Jun 22 09:19:08.615260 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 637/1319] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:08 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:09.632077 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f575e36d-ddef-402f-948f-41c337a2a9f0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:09.632702 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-f575e36d-ddef-402f-948f-41c337a2a9f0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:09.639356 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f575e36d-ddef-402f-948f-41c337a2a9f0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:09.639815 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f575e36d-ddef-402f-948f-41c337a2a9f0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:09.640579 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f575e36d-ddef-402f-948f-41c337a2a9f0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:09.641046 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f575e36d-ddef-402f-948f-41c337a2a9f0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:09.775687 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-f575e36d-ddef-402f-948f-41c337a2a9f0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:09.783862 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f575e36d-ddef-402f-948f-41c337a2a9f0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.155671 Jun 22 09:19:09.784437 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 683/1320] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:09 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:10.801267 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-8bc8285b-bf0a-4f51-9206-4ba78779cdd6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:10.902475 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-8bc8285b-bf0a-4f51-9206-4ba78779cdd6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:10.902475 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8bc8285b-bf0a-4f51-9206-4ba78779cdd6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:10.902475 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8bc8285b-bf0a-4f51-9206-4ba78779cdd6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:10.902475 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8bc8285b-bf0a-4f51-9206-4ba78779cdd6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:10.905403 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8bc8285b-bf0a-4f51-9206-4ba78779cdd6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:10.952030 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-8bc8285b-bf0a-4f51-9206-4ba78779cdd6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:10.960531 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-8bc8285b-bf0a-4f51-9206-4ba78779cdd6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.163479 Jun 22 09:19:10.961136 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 638/1321] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:10 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:11.978127 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f78e1d11-4bc7-48c1-80f0-3f7e5abae413 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:11.978738 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-f78e1d11-4bc7-48c1-80f0-3f7e5abae413 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:11.985429 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f78e1d11-4bc7-48c1-80f0-3f7e5abae413 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:11.985995 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f78e1d11-4bc7-48c1-80f0-3f7e5abae413 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:11.986774 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f78e1d11-4bc7-48c1-80f0-3f7e5abae413 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:11.987551 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f78e1d11-4bc7-48c1-80f0-3f7e5abae413 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:12.121574 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-f78e1d11-4bc7-48c1-80f0-3f7e5abae413 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:12.130664 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f78e1d11-4bc7-48c1-80f0-3f7e5abae413 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.156193 Jun 22 09:19:12.131429 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 684/1322] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:11 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:13.147700 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-08236d1d-3358-4311-b278-997957e58120 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:13.148320 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-08236d1d-3358-4311-b278-997957e58120 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:13.154915 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-08236d1d-3358-4311-b278-997957e58120 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:13.155371 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-08236d1d-3358-4311-b278-997957e58120 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:13.156134 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-08236d1d-3358-4311-b278-997957e58120 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:13.156572 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-08236d1d-3358-4311-b278-997957e58120 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:13.294650 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-08236d1d-3358-4311-b278-997957e58120 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:13.303356 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-08236d1d-3358-4311-b278-997957e58120 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.159528 Jun 22 09:19:13.303915 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 639/1323] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:13 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:14.319689 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9ee1ee86-39c6-440a-abe7-7846d7694ed9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:14.320297 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9ee1ee86-39c6-440a-abe7-7846d7694ed9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:14.323854 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=28 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:19:14.329704 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9ee1ee86-39c6-440a-abe7-7846d7694ed9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:14.330157 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9ee1ee86-39c6-440a-abe7-7846d7694ed9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:14.330921 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9ee1ee86-39c6-440a-abe7-7846d7694ed9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:14.331355 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9ee1ee86-39c6-440a-abe7-7846d7694ed9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:14.460867 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9ee1ee86-39c6-440a-abe7-7846d7694ed9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:14.468945 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9ee1ee86-39c6-440a-abe7-7846d7694ed9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.153021 Jun 22 09:19:14.470104 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 685/1324] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:14 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:15.485891 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-911bea5b-5291-4005-aca1-46ead9571883 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:15.486505 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-911bea5b-5291-4005-aca1-46ead9571883 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:15.493118 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-911bea5b-5291-4005-aca1-46ead9571883 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:15.493563 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-911bea5b-5291-4005-aca1-46ead9571883 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:15.494326 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-911bea5b-5291-4005-aca1-46ead9571883 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:15.494760 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-911bea5b-5291-4005-aca1-46ead9571883 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:15.624770 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-911bea5b-5291-4005-aca1-46ead9571883 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:15.633767 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-911bea5b-5291-4005-aca1-46ead9571883 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.151817 Jun 22 09:19:15.634547 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 640/1325] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:15 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:16.651282 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-590920d1-1254-4e79-a832-a1fa487cf511 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:16.651862 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-590920d1-1254-4e79-a832-a1fa487cf511 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:16.659185 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-590920d1-1254-4e79-a832-a1fa487cf511 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:16.659725 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-590920d1-1254-4e79-a832-a1fa487cf511 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:16.660487 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-590920d1-1254-4e79-a832-a1fa487cf511 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:16.660956 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-590920d1-1254-4e79-a832-a1fa487cf511 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:16.664846 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=82 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:19:16.787335 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-590920d1-1254-4e79-a832-a1fa487cf511 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:16.795147 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-590920d1-1254-4e79-a832-a1fa487cf511 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.147789 Jun 22 09:19:16.795700 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 686/1326] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:16 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:17.812197 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-86d9bb2a-d5c0-4493-902a-99cf142892e3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:17.812807 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-86d9bb2a-d5c0-4493-902a-99cf142892e3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:17.819402 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-86d9bb2a-d5c0-4493-902a-99cf142892e3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:17.819844 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-86d9bb2a-d5c0-4493-902a-99cf142892e3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:17.820624 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-86d9bb2a-d5c0-4493-902a-99cf142892e3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:17.821087 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-86d9bb2a-d5c0-4493-902a-99cf142892e3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:17.961748 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-86d9bb2a-d5c0-4493-902a-99cf142892e3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:17.963438 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-86d9bb2a-d5c0-4493-902a-99cf142892e3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.155128 Jun 22 09:19:17.964006 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 641/1327] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:17 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:18.981960 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c9b8ec46-7bf3-4636-8449-1c2a37e3e0b3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:18.982681 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c9b8ec46-7bf3-4636-8449-1c2a37e3e0b3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:18.990521 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c9b8ec46-7bf3-4636-8449-1c2a37e3e0b3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:18.990971 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c9b8ec46-7bf3-4636-8449-1c2a37e3e0b3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:18.991745 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c9b8ec46-7bf3-4636-8449-1c2a37e3e0b3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:18.992181 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c9b8ec46-7bf3-4636-8449-1c2a37e3e0b3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:19.121098 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c9b8ec46-7bf3-4636-8449-1c2a37e3e0b3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:19.129140 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c9b8ec46-7bf3-4636-8449-1c2a37e3e0b3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.150991 Jun 22 09:19:19.129697 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 687/1328] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:18 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:20.147211 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c526cb79-63ad-45b5-9608-7d1ece52cd49 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:20.147955 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c526cb79-63ad-45b5-9608-7d1ece52cd49 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:20.153928 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c526cb79-63ad-45b5-9608-7d1ece52cd49 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:20.154371 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c526cb79-63ad-45b5-9608-7d1ece52cd49 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:20.155118 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c526cb79-63ad-45b5-9608-7d1ece52cd49 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:20.155549 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c526cb79-63ad-45b5-9608-7d1ece52cd49 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:20.292653 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-c526cb79-63ad-45b5-9608-7d1ece52cd49 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:20.300826 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c526cb79-63ad-45b5-9608-7d1ece52cd49 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.157552 Jun 22 09:19:20.301402 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 642/1329] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:20 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:21.319062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-8b5b1360-9b91-420e-8e30-0e0b6d8210e0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:21.319062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-8b5b1360-9b91-420e-8e30-0e0b6d8210e0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:21.326440 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8b5b1360-9b91-420e-8e30-0e0b6d8210e0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:21.326892 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8b5b1360-9b91-420e-8e30-0e0b6d8210e0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:21.327663 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8b5b1360-9b91-420e-8e30-0e0b6d8210e0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:21.328149 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8b5b1360-9b91-420e-8e30-0e0b6d8210e0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:21.461729 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-8b5b1360-9b91-420e-8e30-0e0b6d8210e0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:21.470885 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-8b5b1360-9b91-420e-8e30-0e0b6d8210e0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.156775 Jun 22 09:19:21.471495 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 688/1330] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:21 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:22.488458 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-469892d7-c0b4-4237-bc48-0178cba2acc3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:22.489005 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-469892d7-c0b4-4237-bc48-0178cba2acc3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:22.495522 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-469892d7-c0b4-4237-bc48-0178cba2acc3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:22.495968 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-469892d7-c0b4-4237-bc48-0178cba2acc3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:22.496723 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-469892d7-c0b4-4237-bc48-0178cba2acc3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:22.497213 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-469892d7-c0b4-4237-bc48-0178cba2acc3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:22.627162 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-469892d7-c0b4-4237-bc48-0178cba2acc3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:22.635106 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-469892d7-c0b4-4237-bc48-0178cba2acc3 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.151159 Jun 22 09:19:22.635668 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 643/1331] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:22 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:23.652288 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-81c8834d-8545-4536-b3ca-aa60e3e34d88 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:23.652925 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-81c8834d-8545-4536-b3ca-aa60e3e34d88 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:23.659908 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-81c8834d-8545-4536-b3ca-aa60e3e34d88 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:23.660351 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-81c8834d-8545-4536-b3ca-aa60e3e34d88 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:23.661130 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-81c8834d-8545-4536-b3ca-aa60e3e34d88 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:23.661565 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-81c8834d-8545-4536-b3ca-aa60e3e34d88 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:23.791287 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-81c8834d-8545-4536-b3ca-aa60e3e34d88 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:23.801170 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-81c8834d-8545-4536-b3ca-aa60e3e34d88 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.152467 Jun 22 09:19:23.801748 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 689/1332] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:23 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:24.818733 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-69b21ded-83ad-4215-bbf0-1c118727b848 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:24.819490 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-69b21ded-83ad-4215-bbf0-1c118727b848 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:24.822977 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=26 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:19:24.827052 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-69b21ded-83ad-4215-bbf0-1c118727b848 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:24.827503 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-69b21ded-83ad-4215-bbf0-1c118727b848 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:24.829224 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-69b21ded-83ad-4215-bbf0-1c118727b848 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:24.829679 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-69b21ded-83ad-4215-bbf0-1c118727b848 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:24.967169 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-69b21ded-83ad-4215-bbf0-1c118727b848 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:24.975110 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-69b21ded-83ad-4215-bbf0-1c118727b848 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.160254 Jun 22 09:19:24.975669 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 644/1333] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:24 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:26.000607 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7fa226e2-7f22-4f45-bbd7-df8d714eaa71 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:26.001247 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7fa226e2-7f22-4f45-bbd7-df8d714eaa71 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:26.007769 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7fa226e2-7f22-4f45-bbd7-df8d714eaa71 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:26.008216 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7fa226e2-7f22-4f45-bbd7-df8d714eaa71 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:26.009001 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7fa226e2-7f22-4f45-bbd7-df8d714eaa71 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:26.009461 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7fa226e2-7f22-4f45-bbd7-df8d714eaa71 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:26.134926 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7fa226e2-7f22-4f45-bbd7-df8d714eaa71 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:26.143652 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7fa226e2-7f22-4f45-bbd7-df8d714eaa71 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.146862 Jun 22 09:19:26.144214 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 690/1334] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:25 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:27.161055 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-80e14de2-f671-43b1-9fb5-392d19ccfd42 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:27.162541 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-80e14de2-f671-43b1-9fb5-392d19ccfd42 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:27.169376 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-80e14de2-f671-43b1-9fb5-392d19ccfd42 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:27.174894 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-80e14de2-f671-43b1-9fb5-392d19ccfd42 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:27.174894 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-80e14de2-f671-43b1-9fb5-392d19ccfd42 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:27.174894 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-80e14de2-f671-43b1-9fb5-392d19ccfd42 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:27.174894 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=78 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:19:27.552803 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-80e14de2-f671-43b1-9fb5-392d19ccfd42 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:27.560667 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-80e14de2-f671-43b1-9fb5-392d19ccfd42 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.404115 Jun 22 09:19:27.561259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 645/1335] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:27 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:28.688574 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d2c102f9-5e19-4081-91bf-2ac2713f8432 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:28.693239 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-d2c102f9-5e19-4081-91bf-2ac2713f8432 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:28.695569 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d2c102f9-5e19-4081-91bf-2ac2713f8432 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:28.696022 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d2c102f9-5e19-4081-91bf-2ac2713f8432 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:28.697224 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d2c102f9-5e19-4081-91bf-2ac2713f8432 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:28.698488 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d2c102f9-5e19-4081-91bf-2ac2713f8432 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:28.828403 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-d2c102f9-5e19-4081-91bf-2ac2713f8432 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:28.836599 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d2c102f9-5e19-4081-91bf-2ac2713f8432 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.262117 Jun 22 09:19:28.837118 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 691/1336] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:28 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:29.853549 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-484f6b41-fe8f-4d03-b736-7d47c1829a69 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:29.854167 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-484f6b41-fe8f-4d03-b736-7d47c1829a69 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:29.861613 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-484f6b41-fe8f-4d03-b736-7d47c1829a69 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:29.862064 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-484f6b41-fe8f-4d03-b736-7d47c1829a69 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:29.862826 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-484f6b41-fe8f-4d03-b736-7d47c1829a69 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:29.863262 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-484f6b41-fe8f-4d03-b736-7d47c1829a69 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:30.000117 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-484f6b41-fe8f-4d03-b736-7d47c1829a69 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:30.008340 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-484f6b41-fe8f-4d03-b736-7d47c1829a69 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.158689 Jun 22 09:19:30.008923 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 646/1337] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:29 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:31.026575 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-417d7ee1-32c1-48a0-adab-74d17c0f31d0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:31.027144 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-417d7ee1-32c1-48a0-adab-74d17c0f31d0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:31.033566 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-417d7ee1-32c1-48a0-adab-74d17c0f31d0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:31.034010 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-417d7ee1-32c1-48a0-adab-74d17c0f31d0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:31.034760 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-417d7ee1-32c1-48a0-adab-74d17c0f31d0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:31.035193 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-417d7ee1-32c1-48a0-adab-74d17c0f31d0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:31.163350 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-417d7ee1-32c1-48a0-adab-74d17c0f31d0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:31.171716 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-417d7ee1-32c1-48a0-adab-74d17c0f31d0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149129 Jun 22 09:19:31.173091 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 692/1338] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:31 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:32.189401 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-774c41e4-4057-435a-a182-3cafd3bd119e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:32.190022 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-774c41e4-4057-435a-a182-3cafd3bd119e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:32.196949 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-774c41e4-4057-435a-a182-3cafd3bd119e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:32.197406 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-774c41e4-4057-435a-a182-3cafd3bd119e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:32.198190 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-774c41e4-4057-435a-a182-3cafd3bd119e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:32.198635 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-774c41e4-4057-435a-a182-3cafd3bd119e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:32.323847 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-774c41e4-4057-435a-a182-3cafd3bd119e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:32.331998 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-774c41e4-4057-435a-a182-3cafd3bd119e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.146577 Jun 22 09:19:32.332573 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 647/1339] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:32 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:33.349790 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-91ad459c-26f8-4c02-bbff-c8544441caf5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:33.350413 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-91ad459c-26f8-4c02-bbff-c8544441caf5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:33.357138 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-91ad459c-26f8-4c02-bbff-c8544441caf5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:33.357656 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-91ad459c-26f8-4c02-bbff-c8544441caf5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:33.358534 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-91ad459c-26f8-4c02-bbff-c8544441caf5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:33.358974 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-91ad459c-26f8-4c02-bbff-c8544441caf5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:33.490303 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-91ad459c-26f8-4c02-bbff-c8544441caf5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:33.498267 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-91ad459c-26f8-4c02-bbff-c8544441caf5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.152742 Jun 22 09:19:33.498856 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 693/1340] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:33 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:34.516620 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-35ff2ac5-0266-47b5-a649-9ac860621eb7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:34.517281 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-35ff2ac5-0266-47b5-a649-9ac860621eb7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:34.523945 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-35ff2ac5-0266-47b5-a649-9ac860621eb7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:34.524395 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-35ff2ac5-0266-47b5-a649-9ac860621eb7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:34.525241 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-35ff2ac5-0266-47b5-a649-9ac860621eb7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:34.525712 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-35ff2ac5-0266-47b5-a649-9ac860621eb7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:34.652353 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-35ff2ac5-0266-47b5-a649-9ac860621eb7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:34.660312 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-35ff2ac5-0266-47b5-a649-9ac860621eb7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.148485 Jun 22 09:19:34.660889 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 648/1341] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:34 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:35.677977 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-caf4cdf9-91e6-4bed-9492-d131ad7ae46e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:35.678554 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-caf4cdf9-91e6-4bed-9492-d131ad7ae46e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:35.685095 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-caf4cdf9-91e6-4bed-9492-d131ad7ae46e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:35.685546 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-caf4cdf9-91e6-4bed-9492-d131ad7ae46e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:35.686314 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-caf4cdf9-91e6-4bed-9492-d131ad7ae46e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:35.686758 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-caf4cdf9-91e6-4bed-9492-d131ad7ae46e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:35.815467 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-caf4cdf9-91e6-4bed-9492-d131ad7ae46e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:35.823287 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-caf4cdf9-91e6-4bed-9492-d131ad7ae46e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149251 Jun 22 09:19:35.823845 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 694/1342] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:35 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:19:36.840651 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-bd7f4685-66f2-4182-9f96-b2005777f5f0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:36.841371 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-bd7f4685-66f2-4182-9f96-b2005777f5f0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:36.848614 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bd7f4685-66f2-4182-9f96-b2005777f5f0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:36.851830 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bd7f4685-66f2-4182-9f96-b2005777f5f0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:36.851830 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bd7f4685-66f2-4182-9f96-b2005777f5f0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:36.851830 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bd7f4685-66f2-4182-9f96-b2005777f5f0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:36.980660 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-bd7f4685-66f2-4182-9f96-b2005777f5f0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:36.989052 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-bd7f4685-66f2-4182-9f96-b2005777f5f0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.152352 Jun 22 09:19:36.990825 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 649/1343] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:36 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:38.005998 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c694db36-a006-4c88-ab80-bd621f46b4ab tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:38.006614 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c694db36-a006-4c88-ab80-bd621f46b4ab tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:38.013522 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c694db36-a006-4c88-ab80-bd621f46b4ab tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:38.013978 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c694db36-a006-4c88-ab80-bd621f46b4ab tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:38.014737 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c694db36-a006-4c88-ab80-bd621f46b4ab tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:38.016133 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c694db36-a006-4c88-ab80-bd621f46b4ab tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:38.147140 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c694db36-a006-4c88-ab80-bd621f46b4ab tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:38.155137 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c694db36-a006-4c88-ab80-bd621f46b4ab tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.153156 Jun 22 09:19:38.155697 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 695/1344] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:38 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:39.172807 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c04091d9-636d-4719-86e5-ef5780b8aab7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:39.173405 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c04091d9-636d-4719-86e5-ef5780b8aab7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:39.179895 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c04091d9-636d-4719-86e5-ef5780b8aab7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:39.180346 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c04091d9-636d-4719-86e5-ef5780b8aab7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:39.181144 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c04091d9-636d-4719-86e5-ef5780b8aab7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:39.181598 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c04091d9-636d-4719-86e5-ef5780b8aab7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:39.309361 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-c04091d9-636d-4719-86e5-ef5780b8aab7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:39.317351 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c04091d9-636d-4719-86e5-ef5780b8aab7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149158 Jun 22 09:19:39.317911 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 650/1345] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:39 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:40.334450 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-b0aeeb35-9698-47ec-9150-50b44ae235fb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:40.335126 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-b0aeeb35-9698-47ec-9150-50b44ae235fb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:40.341860 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b0aeeb35-9698-47ec-9150-50b44ae235fb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:40.342309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b0aeeb35-9698-47ec-9150-50b44ae235fb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:40.343072 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b0aeeb35-9698-47ec-9150-50b44ae235fb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:40.344257 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b0aeeb35-9698-47ec-9150-50b44ae235fb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:40.474243 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-b0aeeb35-9698-47ec-9150-50b44ae235fb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:40.482178 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-b0aeeb35-9698-47ec-9150-50b44ae235fb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.151763 Jun 22 09:19:40.482731 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 696/1346] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:40 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:41.499537 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3ed15fb1-9e4c-4e7f-aa20-183ec263f43f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:41.500696 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3ed15fb1-9e4c-4e7f-aa20-183ec263f43f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:41.508318 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3ed15fb1-9e4c-4e7f-aa20-183ec263f43f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:41.508765 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3ed15fb1-9e4c-4e7f-aa20-183ec263f43f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:41.509553 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3ed15fb1-9e4c-4e7f-aa20-183ec263f43f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:41.509987 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3ed15fb1-9e4c-4e7f-aa20-183ec263f43f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:41.638454 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3ed15fb1-9e4c-4e7f-aa20-183ec263f43f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:41.646897 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3ed15fb1-9e4c-4e7f-aa20-183ec263f43f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.151278 Jun 22 09:19:41.647463 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 651/1347] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:41 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:42.663440 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-09d9fdf5-cc76-4bcc-9efe-29a45426f557 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:42.663995 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-09d9fdf5-cc76-4bcc-9efe-29a45426f557 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:42.670478 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-09d9fdf5-cc76-4bcc-9efe-29a45426f557 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:42.670929 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-09d9fdf5-cc76-4bcc-9efe-29a45426f557 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:42.671692 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-09d9fdf5-cc76-4bcc-9efe-29a45426f557 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:42.672128 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-09d9fdf5-cc76-4bcc-9efe-29a45426f557 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:42.809459 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-09d9fdf5-cc76-4bcc-9efe-29a45426f557 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:42.817868 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-09d9fdf5-cc76-4bcc-9efe-29a45426f557 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.158388 Jun 22 09:19:42.821265 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 697/1348] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:42 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:43.836849 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1c88de9b-f757-4c0a-adf5-444beb8ae2ad tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:43.837542 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1c88de9b-f757-4c0a-adf5-444beb8ae2ad tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:43.844057 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1c88de9b-f757-4c0a-adf5-444beb8ae2ad tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:43.844624 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1c88de9b-f757-4c0a-adf5-444beb8ae2ad tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:43.845425 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1c88de9b-f757-4c0a-adf5-444beb8ae2ad tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:43.845894 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1c88de9b-f757-4c0a-adf5-444beb8ae2ad tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:43.973893 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-1c88de9b-f757-4c0a-adf5-444beb8ae2ad tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:43.981833 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1c88de9b-f757-4c0a-adf5-444beb8ae2ad tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.148836 Jun 22 09:19:43.982403 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 652/1349] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:43 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:44.999555 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f1925bbd-b938-4150-b43c-2e87da6c1a06 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:45.000204 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-f1925bbd-b938-4150-b43c-2e87da6c1a06 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:45.003235 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=26 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:19:45.007967 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f1925bbd-b938-4150-b43c-2e87da6c1a06 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:45.008418 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f1925bbd-b938-4150-b43c-2e87da6c1a06 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:45.009211 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f1925bbd-b938-4150-b43c-2e87da6c1a06 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:45.009652 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f1925bbd-b938-4150-b43c-2e87da6c1a06 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:45.142758 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-f1925bbd-b938-4150-b43c-2e87da6c1a06 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:45.149700 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f1925bbd-b938-4150-b43c-2e87da6c1a06 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.154053 Jun 22 09:19:45.150274 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 698/1350] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:44 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:46.166856 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-d5b61a35-17cf-4e59-9ae1-e5f2c9c6b057 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:46.167401 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-d5b61a35-17cf-4e59-9ae1-e5f2c9c6b057 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:46.174034 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d5b61a35-17cf-4e59-9ae1-e5f2c9c6b057 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:46.174541 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d5b61a35-17cf-4e59-9ae1-e5f2c9c6b057 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:46.175311 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d5b61a35-17cf-4e59-9ae1-e5f2c9c6b057 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:46.175766 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d5b61a35-17cf-4e59-9ae1-e5f2c9c6b057 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:46.304246 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-d5b61a35-17cf-4e59-9ae1-e5f2c9c6b057 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:46.312224 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-d5b61a35-17cf-4e59-9ae1-e5f2c9c6b057 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149431 Jun 22 09:19:46.312808 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 653/1351] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:46 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:47.330262 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7490b9e4-ca95-4f7f-9856-b4ac7d812ef9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:47.330881 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7490b9e4-ca95-4f7f-9856-b4ac7d812ef9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:47.337570 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7490b9e4-ca95-4f7f-9856-b4ac7d812ef9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:47.338047 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7490b9e4-ca95-4f7f-9856-b4ac7d812ef9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:47.338803 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7490b9e4-ca95-4f7f-9856-b4ac7d812ef9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:47.339249 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7490b9e4-ca95-4f7f-9856-b4ac7d812ef9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:47.343212 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=78 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:19:47.472713 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7490b9e4-ca95-4f7f-9856-b4ac7d812ef9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:47.480707 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7490b9e4-ca95-4f7f-9856-b4ac7d812ef9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.154667 Jun 22 09:19:47.481409 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 699/1352] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:47 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:48.504390 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ae42ec3b-492b-4318-a125-0b3db5024de1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:48.505036 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ae42ec3b-492b-4318-a125-0b3db5024de1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:48.511857 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ae42ec3b-492b-4318-a125-0b3db5024de1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:48.512308 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ae42ec3b-492b-4318-a125-0b3db5024de1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:48.513101 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ae42ec3b-492b-4318-a125-0b3db5024de1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:48.513542 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ae42ec3b-492b-4318-a125-0b3db5024de1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:48.641529 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ae42ec3b-492b-4318-a125-0b3db5024de1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:48.649700 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ae42ec3b-492b-4318-a125-0b3db5024de1 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.150207 Jun 22 09:19:48.650268 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 654/1353] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:48 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:49.668070 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-1503c6fe-78d3-456a-a598-be5454981ae2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:49.668702 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-1503c6fe-78d3-456a-a598-be5454981ae2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:49.676276 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1503c6fe-78d3-456a-a598-be5454981ae2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:49.676724 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1503c6fe-78d3-456a-a598-be5454981ae2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:49.677517 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1503c6fe-78d3-456a-a598-be5454981ae2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:49.677955 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1503c6fe-78d3-456a-a598-be5454981ae2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:49.810333 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-1503c6fe-78d3-456a-a598-be5454981ae2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:49.818902 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-1503c6fe-78d3-456a-a598-be5454981ae2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.154911 Jun 22 09:19:49.819463 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 700/1354] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:49 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:50.835749 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-615b4bc5-f068-4bae-8324-55868ee2ffcb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:50.836950 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-615b4bc5-f068-4bae-8324-55868ee2ffcb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:50.842773 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-615b4bc5-f068-4bae-8324-55868ee2ffcb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:50.843226 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-615b4bc5-f068-4bae-8324-55868ee2ffcb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:50.843995 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-615b4bc5-f068-4bae-8324-55868ee2ffcb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:50.844518 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-615b4bc5-f068-4bae-8324-55868ee2ffcb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:50.970466 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-615b4bc5-f068-4bae-8324-55868ee2ffcb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:50.978381 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-615b4bc5-f068-4bae-8324-55868ee2ffcb tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.146499 Jun 22 09:19:50.978937 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 655/1355] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:50 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:51.995005 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-4686a1ab-1d8c-4a3d-87f8-22d1d917153e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:51.995917 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-4686a1ab-1d8c-4a3d-87f8-22d1d917153e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:52.003394 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4686a1ab-1d8c-4a3d-87f8-22d1d917153e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:52.003842 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4686a1ab-1d8c-4a3d-87f8-22d1d917153e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:52.004668 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4686a1ab-1d8c-4a3d-87f8-22d1d917153e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:52.005146 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4686a1ab-1d8c-4a3d-87f8-22d1d917153e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:52.134434 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-4686a1ab-1d8c-4a3d-87f8-22d1d917153e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:52.143109 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-4686a1ab-1d8c-4a3d-87f8-22d1d917153e tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.151895 Jun 22 09:19:52.143672 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 701/1356] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:51 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:53.161071 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ce4fcc01-b6c8-4e34-9040-ce6dc770304a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:53.161611 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ce4fcc01-b6c8-4e34-9040-ce6dc770304a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:53.167533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ce4fcc01-b6c8-4e34-9040-ce6dc770304a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:53.167972 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ce4fcc01-b6c8-4e34-9040-ce6dc770304a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:53.168723 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ce4fcc01-b6c8-4e34-9040-ce6dc770304a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:53.169178 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ce4fcc01-b6c8-4e34-9040-ce6dc770304a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:53.299179 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ce4fcc01-b6c8-4e34-9040-ce6dc770304a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:53.307144 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ce4fcc01-b6c8-4e34-9040-ce6dc770304a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.150624 Jun 22 09:19:53.307901 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 656/1357] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:53 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:54.324908 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e0383a33-247b-4ba9-8f54-728d7a155e45 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:54.325528 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e0383a33-247b-4ba9-8f54-728d7a155e45 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:54.333651 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e0383a33-247b-4ba9-8f54-728d7a155e45 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:54.334099 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e0383a33-247b-4ba9-8f54-728d7a155e45 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:54.334905 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e0383a33-247b-4ba9-8f54-728d7a155e45 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:54.335338 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e0383a33-247b-4ba9-8f54-728d7a155e45 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:54.463632 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-e0383a33-247b-4ba9-8f54-728d7a155e45 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:54.472308 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e0383a33-247b-4ba9-8f54-728d7a155e45 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.151203 Jun 22 09:19:54.472828 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 702/1358] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:54 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:55.489801 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c21bba49-71d8-4e1e-ae2a-906b00e9728d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:55.490366 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c21bba49-71d8-4e1e-ae2a-906b00e9728d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:55.492669 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=26 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:19:55.497439 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c21bba49-71d8-4e1e-ae2a-906b00e9728d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:55.497889 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c21bba49-71d8-4e1e-ae2a-906b00e9728d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:55.498650 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c21bba49-71d8-4e1e-ae2a-906b00e9728d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:55.499086 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c21bba49-71d8-4e1e-ae2a-906b00e9728d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:55.629810 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-c21bba49-71d8-4e1e-ae2a-906b00e9728d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:55.637770 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c21bba49-71d8-4e1e-ae2a-906b00e9728d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.151925 Jun 22 09:19:55.638332 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 657/1359] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:55 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:56.655498 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-80a894a8-d8a1-4651-b3f5-c3585f562b92 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:56.656045 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-80a894a8-d8a1-4651-b3f5-c3585f562b92 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:56.663314 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-80a894a8-d8a1-4651-b3f5-c3585f562b92 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:56.663766 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-80a894a8-d8a1-4651-b3f5-c3585f562b92 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:56.664528 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-80a894a8-d8a1-4651-b3f5-c3585f562b92 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:56.664996 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-80a894a8-d8a1-4651-b3f5-c3585f562b92 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:56.790141 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-80a894a8-d8a1-4651-b3f5-c3585f562b92 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:56.798253 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-80a894a8-d8a1-4651-b3f5-c3585f562b92 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.146683 Jun 22 09:19:56.798815 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 703/1360] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:56 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:57.104509 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:19:57.105062 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Wed Jun 22 09:19:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:19:57.814129 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-903dce1c-cc2e-4e38-a044-ef022e76fabf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:57.814744 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-903dce1c-cc2e-4e38-a044-ef022e76fabf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:57.821236 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-903dce1c-cc2e-4e38-a044-ef022e76fabf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:57.821683 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-903dce1c-cc2e-4e38-a044-ef022e76fabf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:57.822444 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-903dce1c-cc2e-4e38-a044-ef022e76fabf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:57.822877 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-903dce1c-cc2e-4e38-a044-ef022e76fabf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:57.825403 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=78 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:19:57.957578 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-903dce1c-cc2e-4e38-a044-ef022e76fabf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:57.965406 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-903dce1c-cc2e-4e38-a044-ef022e76fabf tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.155177 Jun 22 09:19:57.965965 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 658/1361] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:57 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:19:58.982051 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a083fbb0-c210-457b-b0a5-674eb1ad3070 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:19:58.982662 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-a083fbb0-c210-457b-b0a5-674eb1ad3070 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:19:58.989644 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a083fbb0-c210-457b-b0a5-674eb1ad3070 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:58.990088 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a083fbb0-c210-457b-b0a5-674eb1ad3070 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:58.990842 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a083fbb0-c210-457b-b0a5-674eb1ad3070 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:19:58.991298 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a083fbb0-c210-457b-b0a5-674eb1ad3070 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:19:59.117642 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-a083fbb0-c210-457b-b0a5-674eb1ad3070 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:19:59.125690 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a083fbb0-c210-457b-b0a5-674eb1ad3070 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.147355 Jun 22 09:19:59.126286 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 704/1362] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:19:58 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:00.144599 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-40a0213d-2966-4dbb-a724-8b5918ef29c7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:00.145374 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-40a0213d-2966-4dbb-a724-8b5918ef29c7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:00.151987 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-40a0213d-2966-4dbb-a724-8b5918ef29c7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:00.152436 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-40a0213d-2966-4dbb-a724-8b5918ef29c7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:00.153224 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-40a0213d-2966-4dbb-a724-8b5918ef29c7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:00.153663 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-40a0213d-2966-4dbb-a724-8b5918ef29c7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:00.286325 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-40a0213d-2966-4dbb-a724-8b5918ef29c7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:00.294459 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-40a0213d-2966-4dbb-a724-8b5918ef29c7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.154390 Jun 22 09:20:00.295007 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 659/1363] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:00 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:01.311611 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e716be3d-64e7-44f8-b0c6-987edfd53e7c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:01.312751 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e716be3d-64e7-44f8-b0c6-987edfd53e7c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:01.319679 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e716be3d-64e7-44f8-b0c6-987edfd53e7c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:01.320139 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e716be3d-64e7-44f8-b0c6-987edfd53e7c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:01.321030 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e716be3d-64e7-44f8-b0c6-987edfd53e7c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:01.321481 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e716be3d-64e7-44f8-b0c6-987edfd53e7c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:01.452765 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-e716be3d-64e7-44f8-b0c6-987edfd53e7c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:01.461530 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e716be3d-64e7-44f8-b0c6-987edfd53e7c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.154073 Jun 22 09:20:01.462106 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 705/1364] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:01 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:02.478928 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-7f2219f0-3180-408f-bbe4-ec84355f3e9f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:02.479561 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-7f2219f0-3180-408f-bbe4-ec84355f3e9f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:02.486064 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7f2219f0-3180-408f-bbe4-ec84355f3e9f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:02.486513 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7f2219f0-3180-408f-bbe4-ec84355f3e9f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:02.487260 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7f2219f0-3180-408f-bbe4-ec84355f3e9f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:02.487696 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7f2219f0-3180-408f-bbe4-ec84355f3e9f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:02.616039 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-7f2219f0-3180-408f-bbe4-ec84355f3e9f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:02.624109 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-7f2219f0-3180-408f-bbe4-ec84355f3e9f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.148956 Jun 22 09:20:02.624628 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 660/1365] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:02 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:03.641629 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9ea0d2d2-64bc-4a69-9843-5e060af7ae47 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:03.642247 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9ea0d2d2-64bc-4a69-9843-5e060af7ae47 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:03.648906 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9ea0d2d2-64bc-4a69-9843-5e060af7ae47 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:03.649360 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9ea0d2d2-64bc-4a69-9843-5e060af7ae47 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:03.650119 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9ea0d2d2-64bc-4a69-9843-5e060af7ae47 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:03.650555 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9ea0d2d2-64bc-4a69-9843-5e060af7ae47 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:03.828445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9ea0d2d2-64bc-4a69-9843-5e060af7ae47 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:03.836561 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9ea0d2d2-64bc-4a69-9843-5e060af7ae47 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.199559 Jun 22 09:20:03.837307 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 706/1366] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:03 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:04.854254 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f108ad7c-16ca-4777-aff9-f9fa37a2a515 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:04.854897 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f108ad7c-16ca-4777-aff9-f9fa37a2a515 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:04.861343 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f108ad7c-16ca-4777-aff9-f9fa37a2a515 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:04.861791 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f108ad7c-16ca-4777-aff9-f9fa37a2a515 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:04.862599 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f108ad7c-16ca-4777-aff9-f9fa37a2a515 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:04.863051 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f108ad7c-16ca-4777-aff9-f9fa37a2a515 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:04.992008 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-f108ad7c-16ca-4777-aff9-f9fa37a2a515 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:05.000166 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f108ad7c-16ca-4777-aff9-f9fa37a2a515 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149554 Jun 22 09:20:05.000735 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 661/1367] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:04 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:06.017321 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a9f541e3-196c-4b8a-bad1-98f272e92a16 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:06.017937 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-a9f541e3-196c-4b8a-bad1-98f272e92a16 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:06.024378 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a9f541e3-196c-4b8a-bad1-98f272e92a16 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:06.024856 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a9f541e3-196c-4b8a-bad1-98f272e92a16 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:06.025621 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a9f541e3-196c-4b8a-bad1-98f272e92a16 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:06.026063 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a9f541e3-196c-4b8a-bad1-98f272e92a16 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:06.158455 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-a9f541e3-196c-4b8a-bad1-98f272e92a16 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:06.166356 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a9f541e3-196c-4b8a-bad1-98f272e92a16 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.153216 Jun 22 09:20:06.166913 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 707/1368] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:06 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:07.184433 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-683bd1db-2eea-4d04-ae55-a62d92562487 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:07.185026 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-683bd1db-2eea-4d04-ae55-a62d92562487 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:07.191545 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-683bd1db-2eea-4d04-ae55-a62d92562487 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:07.191996 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-683bd1db-2eea-4d04-ae55-a62d92562487 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:07.192760 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-683bd1db-2eea-4d04-ae55-a62d92562487 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:07.193225 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-683bd1db-2eea-4d04-ae55-a62d92562487 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:07.320724 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-683bd1db-2eea-4d04-ae55-a62d92562487 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:07.329258 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-683bd1db-2eea-4d04-ae55-a62d92562487 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149010 Jun 22 09:20:07.329814 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 662/1369] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:07 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:08.346614 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a8008afe-1456-4941-90b2-0685f819b014 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:08.347231 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-a8008afe-1456-4941-90b2-0685f819b014 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:08.353942 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a8008afe-1456-4941-90b2-0685f819b014 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:08.354392 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a8008afe-1456-4941-90b2-0685f819b014 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:08.355152 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a8008afe-1456-4941-90b2-0685f819b014 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:08.355589 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a8008afe-1456-4941-90b2-0685f819b014 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:08.481727 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-a8008afe-1456-4941-90b2-0685f819b014 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:08.489748 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a8008afe-1456-4941-90b2-0685f819b014 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.147582 Jun 22 09:20:08.490307 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 708/1370] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:08 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:09.506608 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-4eba762a-9aff-4976-9fd9-8037ad5bf7cc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:09.507216 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-4eba762a-9aff-4976-9fd9-8037ad5bf7cc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:09.513935 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4eba762a-9aff-4976-9fd9-8037ad5bf7cc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:09.514380 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4eba762a-9aff-4976-9fd9-8037ad5bf7cc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:09.515683 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4eba762a-9aff-4976-9fd9-8037ad5bf7cc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:09.516137 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4eba762a-9aff-4976-9fd9-8037ad5bf7cc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:09.645679 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-4eba762a-9aff-4976-9fd9-8037ad5bf7cc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:09.653824 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-4eba762a-9aff-4976-9fd9-8037ad5bf7cc tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.150944 Jun 22 09:20:09.654318 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 663/1371] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:09 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:10.669897 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-1b356869-500d-43f1-945c-9103a924718b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:10.670488 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-1b356869-500d-43f1-945c-9103a924718b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:10.677688 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1b356869-500d-43f1-945c-9103a924718b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:10.678134 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1b356869-500d-43f1-945c-9103a924718b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:10.679012 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1b356869-500d-43f1-945c-9103a924718b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:10.679349 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1b356869-500d-43f1-945c-9103a924718b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:10.807810 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-1b356869-500d-43f1-945c-9103a924718b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:10.816475 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-1b356869-500d-43f1-945c-9103a924718b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.150420 Jun 22 09:20:10.817069 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 709/1372] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:10 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:11.833916 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1cb65a65-1e64-4123-94e1-03d1ca404c48 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:11.834562 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1cb65a65-1e64-4123-94e1-03d1ca404c48 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:11.841145 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1cb65a65-1e64-4123-94e1-03d1ca404c48 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:11.841593 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1cb65a65-1e64-4123-94e1-03d1ca404c48 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:11.842353 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1cb65a65-1e64-4123-94e1-03d1ca404c48 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:11.842819 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1cb65a65-1e64-4123-94e1-03d1ca404c48 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:11.973270 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-1cb65a65-1e64-4123-94e1-03d1ca404c48 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:11.981281 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1cb65a65-1e64-4123-94e1-03d1ca404c48 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.151128 Jun 22 09:20:11.981809 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 664/1373] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:11 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:12.997849 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c397ada4-98bb-4c35-a44e-c094c46d91a6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:12.998462 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c397ada4-98bb-4c35-a44e-c094c46d91a6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:13.005190 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c397ada4-98bb-4c35-a44e-c094c46d91a6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:13.005636 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c397ada4-98bb-4c35-a44e-c094c46d91a6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:13.006393 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c397ada4-98bb-4c35-a44e-c094c46d91a6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:13.006830 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c397ada4-98bb-4c35-a44e-c094c46d91a6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:13.136159 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c397ada4-98bb-4c35-a44e-c094c46d91a6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:13.145018 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c397ada4-98bb-4c35-a44e-c094c46d91a6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.151011 Jun 22 09:20:13.145585 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 710/1374] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:12 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:14.161984 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-81d70ea2-2375-4d72-8ced-cc57c270676c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:14.162602 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-81d70ea2-2375-4d72-8ced-cc57c270676c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:14.169165 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-81d70ea2-2375-4d72-8ced-cc57c270676c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:14.169627 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-81d70ea2-2375-4d72-8ced-cc57c270676c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:14.170392 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-81d70ea2-2375-4d72-8ced-cc57c270676c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:14.170882 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-81d70ea2-2375-4d72-8ced-cc57c270676c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:14.299685 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-81d70ea2-2375-4d72-8ced-cc57c270676c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:14.307746 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-81d70ea2-2375-4d72-8ced-cc57c270676c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149662 Jun 22 09:20:14.308315 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 665/1375] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:14 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:15.324754 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-4fee7d17-2e13-4f30-a9f3-1d35d44037c4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:15.325414 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-4fee7d17-2e13-4f30-a9f3-1d35d44037c4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:15.328308 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=26 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:20:15.333083 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4fee7d17-2e13-4f30-a9f3-1d35d44037c4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:15.333535 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4fee7d17-2e13-4f30-a9f3-1d35d44037c4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:15.334297 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4fee7d17-2e13-4f30-a9f3-1d35d44037c4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:15.334739 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4fee7d17-2e13-4f30-a9f3-1d35d44037c4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:15.467377 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-4fee7d17-2e13-4f30-a9f3-1d35d44037c4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:15.476106 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-4fee7d17-2e13-4f30-a9f3-1d35d44037c4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.155319 Jun 22 09:20:15.476674 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 711/1376] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:15 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:16.492187 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-4007869b-2da4-4abc-bda9-5ca05f348cb8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:16.492832 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-4007869b-2da4-4abc-bda9-5ca05f348cb8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:16.499576 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4007869b-2da4-4abc-bda9-5ca05f348cb8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:16.500023 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4007869b-2da4-4abc-bda9-5ca05f348cb8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:16.500803 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4007869b-2da4-4abc-bda9-5ca05f348cb8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:16.501248 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4007869b-2da4-4abc-bda9-5ca05f348cb8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:16.636735 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-4007869b-2da4-4abc-bda9-5ca05f348cb8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:16.645154 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-4007869b-2da4-4abc-bda9-5ca05f348cb8 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.156856 Jun 22 09:20:16.645717 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 666/1377] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:16 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:17.661933 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-0c3eff27-e976-4ab5-8430-7295d47d3099 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:17.662590 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-0c3eff27-e976-4ab5-8430-7295d47d3099 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:17.669091 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0c3eff27-e976-4ab5-8430-7295d47d3099 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:17.669546 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0c3eff27-e976-4ab5-8430-7295d47d3099 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:17.670308 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0c3eff27-e976-4ab5-8430-7295d47d3099 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:17.671261 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0c3eff27-e976-4ab5-8430-7295d47d3099 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:17.673916 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=78 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:20:17.806395 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-0c3eff27-e976-4ab5-8430-7295d47d3099 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:17.815048 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-0c3eff27-e976-4ab5-8430-7295d47d3099 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.156945 Jun 22 09:20:17.815593 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 712/1378] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:17 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:18.832566 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3ef02168-9aec-4c6d-9830-91f7e13afbc7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:18.833416 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3ef02168-9aec-4c6d-9830-91f7e13afbc7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:18.839730 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3ef02168-9aec-4c6d-9830-91f7e13afbc7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:18.840181 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3ef02168-9aec-4c6d-9830-91f7e13afbc7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:18.840989 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3ef02168-9aec-4c6d-9830-91f7e13afbc7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:18.841424 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3ef02168-9aec-4c6d-9830-91f7e13afbc7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:18.969189 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3ef02168-9aec-4c6d-9830-91f7e13afbc7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:18.977154 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3ef02168-9aec-4c6d-9830-91f7e13afbc7 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.148501 Jun 22 09:20:18.977709 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 667/1379] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:18 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:20:19.781331 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:20:19.781921 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Wed Jun 22 09:20:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:20:19.994800 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9ae8c1c2-d9ee-4152-92f1-c5cf34e31aa2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:19.995335 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9ae8c1c2-d9ee-4152-92f1-c5cf34e31aa2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:20.002015 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9ae8c1c2-d9ee-4152-92f1-c5cf34e31aa2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:20.002464 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9ae8c1c2-d9ee-4152-92f1-c5cf34e31aa2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:20.003222 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9ae8c1c2-d9ee-4152-92f1-c5cf34e31aa2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:20.003681 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9ae8c1c2-d9ee-4152-92f1-c5cf34e31aa2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:20.135974 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9ae8c1c2-d9ee-4152-92f1-c5cf34e31aa2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:20.145913 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9ae8c1c2-d9ee-4152-92f1-c5cf34e31aa2 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.155002 Jun 22 09:20:20.146489 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 713/1380] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:19 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:21.163280 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-d98cdb5d-1d32-4692-8fb1-12efc3c6e965 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:21.164032 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-d98cdb5d-1d32-4692-8fb1-12efc3c6e965 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:21.170009 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d98cdb5d-1d32-4692-8fb1-12efc3c6e965 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:21.171211 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d98cdb5d-1d32-4692-8fb1-12efc3c6e965 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:21.172052 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d98cdb5d-1d32-4692-8fb1-12efc3c6e965 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:21.172491 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d98cdb5d-1d32-4692-8fb1-12efc3c6e965 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:21.316602 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-d98cdb5d-1d32-4692-8fb1-12efc3c6e965 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:21.324609 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-d98cdb5d-1d32-4692-8fb1-12efc3c6e965 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.165275 Jun 22 09:20:21.325192 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 668/1381] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:21 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:22.342138 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-acdddefd-e1c9-45ca-b55a-d118b23fa81c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:22.342774 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-acdddefd-e1c9-45ca-b55a-d118b23fa81c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:22.348892 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-acdddefd-e1c9-45ca-b55a-d118b23fa81c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:22.349335 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-acdddefd-e1c9-45ca-b55a-d118b23fa81c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:22.350089 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-acdddefd-e1c9-45ca-b55a-d118b23fa81c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:22.350517 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-acdddefd-e1c9-45ca-b55a-d118b23fa81c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:22.474989 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-acdddefd-e1c9-45ca-b55a-d118b23fa81c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:22.482968 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-acdddefd-e1c9-45ca-b55a-d118b23fa81c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.144570 Jun 22 09:20:22.483716 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 714/1382] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:22 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:23.501545 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-173c4530-ae60-4a1c-8086-7d9652af7912 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:23.502430 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-173c4530-ae60-4a1c-8086-7d9652af7912 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:23.509142 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-173c4530-ae60-4a1c-8086-7d9652af7912 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:23.509599 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-173c4530-ae60-4a1c-8086-7d9652af7912 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:23.510374 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-173c4530-ae60-4a1c-8086-7d9652af7912 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:23.510821 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-173c4530-ae60-4a1c-8086-7d9652af7912 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:23.643088 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-173c4530-ae60-4a1c-8086-7d9652af7912 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:23.651063 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-173c4530-ae60-4a1c-8086-7d9652af7912 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.154986 Jun 22 09:20:23.651658 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 669/1383] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:23 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:24.667402 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-0f4c22b5-0a13-417f-8da2-53cfdaf6b731 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:24.668014 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-0f4c22b5-0a13-417f-8da2-53cfdaf6b731 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:24.674669 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0f4c22b5-0a13-417f-8da2-53cfdaf6b731 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:24.675113 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0f4c22b5-0a13-417f-8da2-53cfdaf6b731 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:24.675868 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0f4c22b5-0a13-417f-8da2-53cfdaf6b731 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:24.676296 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0f4c22b5-0a13-417f-8da2-53cfdaf6b731 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:24.802357 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-0f4c22b5-0a13-417f-8da2-53cfdaf6b731 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:24.810228 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-0f4c22b5-0a13-417f-8da2-53cfdaf6b731 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.146713 Jun 22 09:20:24.811322 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 715/1384] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:24 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:25.827983 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-d0d6ca46-efe8-4f07-a254-518222a965f4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:25.828599 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-d0d6ca46-efe8-4f07-a254-518222a965f4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:25.830950 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=26 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:20:25.835735 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d0d6ca46-efe8-4f07-a254-518222a965f4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:25.836187 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d0d6ca46-efe8-4f07-a254-518222a965f4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:25.836977 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d0d6ca46-efe8-4f07-a254-518222a965f4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:25.837420 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d0d6ca46-efe8-4f07-a254-518222a965f4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:25.970189 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-d0d6ca46-efe8-4f07-a254-518222a965f4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:25.978141 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-d0d6ca46-efe8-4f07-a254-518222a965f4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.154543 Jun 22 09:20:25.978698 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 670/1385] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:25 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:26.995034 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-11152b5c-7628-4009-bb18-097c82cedf2c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:26.999916 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-11152b5c-7628-4009-bb18-097c82cedf2c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:27.009885 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-11152b5c-7628-4009-bb18-097c82cedf2c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:27.010339 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-11152b5c-7628-4009-bb18-097c82cedf2c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:27.011112 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-11152b5c-7628-4009-bb18-097c82cedf2c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:27.011549 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-11152b5c-7628-4009-bb18-097c82cedf2c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:27.143473 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-11152b5c-7628-4009-bb18-097c82cedf2c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:27.151545 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-11152b5c-7628-4009-bb18-097c82cedf2c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.160419 Jun 22 09:20:27.152107 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 716/1386] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:26 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:28.168356 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-afe1b7d5-8455-4c1d-b122-72253b3be466 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:28.169006 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-afe1b7d5-8455-4c1d-b122-72253b3be466 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:28.175694 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-afe1b7d5-8455-4c1d-b122-72253b3be466 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:28.176147 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-afe1b7d5-8455-4c1d-b122-72253b3be466 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:28.176957 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-afe1b7d5-8455-4c1d-b122-72253b3be466 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:28.177402 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-afe1b7d5-8455-4c1d-b122-72253b3be466 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:28.181374 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=78 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:20:28.304741 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-afe1b7d5-8455-4c1d-b122-72253b3be466 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:28.313416 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-afe1b7d5-8455-4c1d-b122-72253b3be466 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.148940 Jun 22 09:20:28.313979 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 671/1387] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:28 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:29.330291 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2d59651b-867d-4cc4-8753-fd80722ec97f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:29.330911 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2d59651b-867d-4cc4-8753-fd80722ec97f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:29.337610 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2d59651b-867d-4cc4-8753-fd80722ec97f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:29.338093 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2d59651b-867d-4cc4-8753-fd80722ec97f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:29.338865 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2d59651b-867d-4cc4-8753-fd80722ec97f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:29.339300 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2d59651b-867d-4cc4-8753-fd80722ec97f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:29.471703 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-2d59651b-867d-4cc4-8753-fd80722ec97f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:29.479587 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2d59651b-867d-4cc4-8753-fd80722ec97f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.154073 Jun 22 09:20:29.480143 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 717/1388] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:29 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:30.496723 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-9f62d018-646a-45d5-b697-c55fc4b67a6b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:30.497315 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-9f62d018-646a-45d5-b697-c55fc4b67a6b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:30.504498 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9f62d018-646a-45d5-b697-c55fc4b67a6b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:30.504994 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9f62d018-646a-45d5-b697-c55fc4b67a6b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:30.505756 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9f62d018-646a-45d5-b697-c55fc4b67a6b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:30.506200 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9f62d018-646a-45d5-b697-c55fc4b67a6b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:30.637344 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-9f62d018-646a-45d5-b697-c55fc4b67a6b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:30.645938 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-9f62d018-646a-45d5-b697-c55fc4b67a6b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.153170 Jun 22 09:20:30.646665 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 672/1389] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:30 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:31.663983 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-3e610d81-8045-4eba-8bc5-c0693f32a564 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:31.664991 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-3e610d81-8045-4eba-8bc5-c0693f32a564 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:31.672668 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3e610d81-8045-4eba-8bc5-c0693f32a564 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:31.673162 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3e610d81-8045-4eba-8bc5-c0693f32a564 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:31.673907 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3e610d81-8045-4eba-8bc5-c0693f32a564 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:31.674354 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3e610d81-8045-4eba-8bc5-c0693f32a564 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:31.809025 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-3e610d81-8045-4eba-8bc5-c0693f32a564 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:31.817600 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-3e610d81-8045-4eba-8bc5-c0693f32a564 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.157465 Jun 22 09:20:31.818156 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 718/1390] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:31 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:32.834669 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-47e33f35-f144-4c5f-9723-7ee6701a0973 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:32.835275 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-47e33f35-f144-4c5f-9723-7ee6701a0973 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:32.841773 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-47e33f35-f144-4c5f-9723-7ee6701a0973 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:32.842373 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-47e33f35-f144-4c5f-9723-7ee6701a0973 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:32.843128 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-47e33f35-f144-4c5f-9723-7ee6701a0973 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:32.843562 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-47e33f35-f144-4c5f-9723-7ee6701a0973 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:32.971385 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-47e33f35-f144-4c5f-9723-7ee6701a0973 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:32.979274 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-47e33f35-f144-4c5f-9723-7ee6701a0973 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.148479 Jun 22 09:20:32.979829 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 673/1391] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:32 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:33.996512 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-3abc35bb-665f-4776-9af2-a9851dd1d484 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:33.997113 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-3abc35bb-665f-4776-9af2-a9851dd1d484 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:34.003767 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3abc35bb-665f-4776-9af2-a9851dd1d484 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:34.004213 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3abc35bb-665f-4776-9af2-a9851dd1d484 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:34.005003 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3abc35bb-665f-4776-9af2-a9851dd1d484 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:34.005436 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3abc35bb-665f-4776-9af2-a9851dd1d484 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:34.133719 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-3abc35bb-665f-4776-9af2-a9851dd1d484 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:34.143050 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-3abc35bb-665f-4776-9af2-a9851dd1d484 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.150419 Jun 22 09:20:34.143640 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 719/1392] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:33 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:35.159671 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-806346c9-80ea-4513-aca4-9625e5e0e725 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:35.160279 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-806346c9-80ea-4513-aca4-9625e5e0e725 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:35.166850 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-806346c9-80ea-4513-aca4-9625e5e0e725 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:35.167297 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-806346c9-80ea-4513-aca4-9625e5e0e725 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:35.168051 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-806346c9-80ea-4513-aca4-9625e5e0e725 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:35.168485 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-806346c9-80ea-4513-aca4-9625e5e0e725 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:35.296937 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-806346c9-80ea-4513-aca4-9625e5e0e725 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:35.304927 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-806346c9-80ea-4513-aca4-9625e5e0e725 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149102 Jun 22 09:20:35.305484 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 674/1393] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:35 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:36.322606 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-4d80ba30-f707-4857-8961-2af26f15a467 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:36.323209 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-4d80ba30-f707-4857-8961-2af26f15a467 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:36.330309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4d80ba30-f707-4857-8961-2af26f15a467 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:36.330760 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4d80ba30-f707-4857-8961-2af26f15a467 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:36.331523 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4d80ba30-f707-4857-8961-2af26f15a467 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:36.331967 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4d80ba30-f707-4857-8961-2af26f15a467 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:36.464615 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-4d80ba30-f707-4857-8961-2af26f15a467 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:36.473654 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-4d80ba30-f707-4857-8961-2af26f15a467 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.154924 Jun 22 09:20:36.474213 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 720/1394] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:36 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:37.491057 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-bba61cac-c1d6-4935-8c33-fba80aed344b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:37.492244 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-bba61cac-c1d6-4935-8c33-fba80aed344b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:37.499522 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bba61cac-c1d6-4935-8c33-fba80aed344b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:37.499964 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bba61cac-c1d6-4935-8c33-fba80aed344b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:37.500736 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bba61cac-c1d6-4935-8c33-fba80aed344b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:37.501216 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bba61cac-c1d6-4935-8c33-fba80aed344b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:37.635931 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-bba61cac-c1d6-4935-8c33-fba80aed344b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:37.644948 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-bba61cac-c1d6-4935-8c33-fba80aed344b tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.157981 Jun 22 09:20:37.645503 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 675/1395] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:37 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:38.661941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-711816f3-76bc-4829-9f02-2f03a79af771 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:38.662547 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-711816f3-76bc-4829-9f02-2f03a79af771 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:38.668996 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-711816f3-76bc-4829-9f02-2f03a79af771 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:38.670021 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-711816f3-76bc-4829-9f02-2f03a79af771 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:38.670814 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-711816f3-76bc-4829-9f02-2f03a79af771 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:38.671248 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-711816f3-76bc-4829-9f02-2f03a79af771 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:38.795769 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-711816f3-76bc-4829-9f02-2f03a79af771 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:38.803702 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-711816f3-76bc-4829-9f02-2f03a79af771 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.145585 Jun 22 09:20:38.804258 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 721/1396] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:38 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:39.821731 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-336b522e-9f3c-4a80-906a-6c71c45c729d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:39.822258 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-336b522e-9f3c-4a80-906a-6c71c45c729d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:39.829461 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-336b522e-9f3c-4a80-906a-6c71c45c729d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:39.829904 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-336b522e-9f3c-4a80-906a-6c71c45c729d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:39.830674 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-336b522e-9f3c-4a80-906a-6c71c45c729d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:39.831091 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-336b522e-9f3c-4a80-906a-6c71c45c729d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:39.962251 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-336b522e-9f3c-4a80-906a-6c71c45c729d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:39.970493 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-336b522e-9f3c-4a80-906a-6c71c45c729d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.152719 Jun 22 09:20:39.971061 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 676/1397] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:39 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:40.988218 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9c86c14e-392f-4a4b-b775-f10a272a8ae6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:40.988804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9c86c14e-392f-4a4b-b775-f10a272a8ae6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:40.995349 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9c86c14e-392f-4a4b-b775-f10a272a8ae6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:40.995801 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9c86c14e-392f-4a4b-b775-f10a272a8ae6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:40.996591 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9c86c14e-392f-4a4b-b775-f10a272a8ae6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:40.997058 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9c86c14e-392f-4a4b-b775-f10a272a8ae6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:41.125930 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9c86c14e-392f-4a4b-b775-f10a272a8ae6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:41.134344 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9c86c14e-392f-4a4b-b775-f10a272a8ae6 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.150057 Jun 22 09:20:41.136743 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 722/1398] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:40 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:42.154508 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c8848ec2-81b8-49e7-8aec-5b34be270a68 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:42.154508 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c8848ec2-81b8-49e7-8aec-5b34be270a68 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:42.160152 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c8848ec2-81b8-49e7-8aec-5b34be270a68 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:42.160613 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c8848ec2-81b8-49e7-8aec-5b34be270a68 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:42.161419 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c8848ec2-81b8-49e7-8aec-5b34be270a68 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:42.161859 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c8848ec2-81b8-49e7-8aec-5b34be270a68 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:42.291886 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-c8848ec2-81b8-49e7-8aec-5b34be270a68 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:42.300044 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c8848ec2-81b8-49e7-8aec-5b34be270a68 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.152645 Jun 22 09:20:42.300607 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 677/1399] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:42 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:43.317102 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2e8d1449-30c6-4616-a2e8-118d8b31df6f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:43.317715 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2e8d1449-30c6-4616-a2e8-118d8b31df6f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:43.324340 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2e8d1449-30c6-4616-a2e8-118d8b31df6f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:43.324804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2e8d1449-30c6-4616-a2e8-118d8b31df6f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:43.325714 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2e8d1449-30c6-4616-a2e8-118d8b31df6f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:43.326178 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2e8d1449-30c6-4616-a2e8-118d8b31df6f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:43.455815 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-2e8d1449-30c6-4616-a2e8-118d8b31df6f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:43.463694 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2e8d1449-30c6-4616-a2e8-118d8b31df6f tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.150553 Jun 22 09:20:43.464256 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 723/1400] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:43 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:44.481313 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b25ffb0e-3759-417f-b565-9394f03d861a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:44.482869 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-b25ffb0e-3759-417f-b565-9394f03d861a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:44.488955 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b25ffb0e-3759-417f-b565-9394f03d861a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:44.489404 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b25ffb0e-3759-417f-b565-9394f03d861a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:44.490166 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b25ffb0e-3759-417f-b565-9394f03d861a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:44.490605 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b25ffb0e-3759-417f-b565-9394f03d861a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:44.615285 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-b25ffb0e-3759-417f-b565-9394f03d861a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:44.624286 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-b25ffb0e-3759-417f-b565-9394f03d861a tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.146901 Jun 22 09:20:44.624879 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 678/1401] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:44 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:45.642190 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-23d2b46b-6c16-4966-967e-d478c081ad84 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:45.642805 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-23d2b46b-6c16-4966-967e-d478c081ad84 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:45.645164 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=26 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:20:45.649907 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-23d2b46b-6c16-4966-967e-d478c081ad84 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:45.650361 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-23d2b46b-6c16-4966-967e-d478c081ad84 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:45.651122 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-23d2b46b-6c16-4966-967e-d478c081ad84 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:45.651559 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-23d2b46b-6c16-4966-967e-d478c081ad84 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:45.782499 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-23d2b46b-6c16-4966-967e-d478c081ad84 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:45.790465 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-23d2b46b-6c16-4966-967e-d478c081ad84 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.152873 Jun 22 09:20:45.791020 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 724/1402] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:45 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:46.807417 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-38f7aa46-19c0-4c4e-9f44-72a055b05675 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:46.808029 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-38f7aa46-19c0-4c4e-9f44-72a055b05675 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:46.814727 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-38f7aa46-19c0-4c4e-9f44-72a055b05675 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:46.815175 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-38f7aa46-19c0-4c4e-9f44-72a055b05675 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:46.815935 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-38f7aa46-19c0-4c4e-9f44-72a055b05675 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:46.816383 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-38f7aa46-19c0-4c4e-9f44-72a055b05675 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:46.945206 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-38f7aa46-19c0-4c4e-9f44-72a055b05675 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:46.953683 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-38f7aa46-19c0-4c4e-9f44-72a055b05675 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.150150 Jun 22 09:20:46.954249 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 679/1403] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:46 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:47.970580 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e7c1ff72-8676-46a2-8cbf-a5773c508b45 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:47.971188 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e7c1ff72-8676-46a2-8cbf-a5773c508b45 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:47.977709 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e7c1ff72-8676-46a2-8cbf-a5773c508b45 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:47.978155 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e7c1ff72-8676-46a2-8cbf-a5773c508b45 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:47.978915 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e7c1ff72-8676-46a2-8cbf-a5773c508b45 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:47.979344 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e7c1ff72-8676-46a2-8cbf-a5773c508b45 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:47.982274 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=78 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:20:48.113185 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-e7c1ff72-8676-46a2-8cbf-a5773c508b45 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:48.121072 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e7c1ff72-8676-46a2-8cbf-a5773c508b45 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.155146 Jun 22 09:20:48.121634 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 725/1404] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:47 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:49.137685 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f26b004e-4364-4808-922a-ee67c2a93eec tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:49.138319 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f26b004e-4364-4808-922a-ee67c2a93eec tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:49.144725 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f26b004e-4364-4808-922a-ee67c2a93eec tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:49.145207 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f26b004e-4364-4808-922a-ee67c2a93eec tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:49.145981 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f26b004e-4364-4808-922a-ee67c2a93eec tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:49.146407 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f26b004e-4364-4808-922a-ee67c2a93eec tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:49.273005 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-f26b004e-4364-4808-922a-ee67c2a93eec tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:49.281717 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f26b004e-4364-4808-922a-ee67c2a93eec tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.148118 Jun 22 09:20:49.282281 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 680/1405] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:49 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:50.298455 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f4e84a17-d978-4c83-abd7-a082fda68cac tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:50.299071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-f4e84a17-d978-4c83-abd7-a082fda68cac tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:50.305555 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f4e84a17-d978-4c83-abd7-a082fda68cac tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:50.306006 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f4e84a17-d978-4c83-abd7-a082fda68cac tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:50.306766 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f4e84a17-d978-4c83-abd7-a082fda68cac tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:50.307207 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f4e84a17-d978-4c83-abd7-a082fda68cac tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:50.436413 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-f4e84a17-d978-4c83-abd7-a082fda68cac tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:50.444454 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f4e84a17-d978-4c83-abd7-a082fda68cac tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149952 Jun 22 09:20:50.445048 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 726/1406] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:50 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:20:51.461825 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-61dad482-99f6-4e7c-b94b-b8b5805726f0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:51.462348 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-61dad482-99f6-4e7c-b94b-b8b5805726f0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:51.469076 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-61dad482-99f6-4e7c-b94b-b8b5805726f0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:51.469528 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-61dad482-99f6-4e7c-b94b-b8b5805726f0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:51.470298 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-61dad482-99f6-4e7c-b94b-b8b5805726f0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:51.470738 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-61dad482-99f6-4e7c-b94b-b8b5805726f0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:51.601914 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-61dad482-99f6-4e7c-b94b-b8b5805726f0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:51.610154 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-61dad482-99f6-4e7c-b94b-b8b5805726f0 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.152508 Jun 22 09:20:51.610720 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 681/1407] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:51 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:52.628652 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-34b25bdf-877b-4846-87b5-936e2103757c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:52.628652 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-34b25bdf-877b-4846-87b5-936e2103757c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:52.634929 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-34b25bdf-877b-4846-87b5-936e2103757c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:52.635240 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-34b25bdf-877b-4846-87b5-936e2103757c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:52.636020 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-34b25bdf-877b-4846-87b5-936e2103757c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:52.636719 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-34b25bdf-877b-4846-87b5-936e2103757c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:52.765310 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-34b25bdf-877b-4846-87b5-936e2103757c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:52.773261 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-34b25bdf-877b-4846-87b5-936e2103757c tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149850 Jun 22 09:20:52.773833 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 727/1408] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:52 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:53.790662 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3abb51d6-47c0-47d9-b8a9-2aac44b158e4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:53.791483 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3abb51d6-47c0-47d9-b8a9-2aac44b158e4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:53.798851 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3abb51d6-47c0-47d9-b8a9-2aac44b158e4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:53.799295 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3abb51d6-47c0-47d9-b8a9-2aac44b158e4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:53.800052 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3abb51d6-47c0-47d9-b8a9-2aac44b158e4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:53.800483 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3abb51d6-47c0-47d9-b8a9-2aac44b158e4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:53.929635 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3abb51d6-47c0-47d9-b8a9-2aac44b158e4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:53.938179 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3abb51d6-47c0-47d9-b8a9-2aac44b158e4 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.151349 Jun 22 09:20:53.938763 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 682/1409] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:53 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:54.955289 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7c733974-1c37-4396-855d-abe56efd01ea tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:54.955836 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7c733974-1c37-4396-855d-abe56efd01ea tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:54.962325 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7c733974-1c37-4396-855d-abe56efd01ea tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:54.962773 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7c733974-1c37-4396-855d-abe56efd01ea tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:54.963523 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7c733974-1c37-4396-855d-abe56efd01ea tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:54.963957 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7c733974-1c37-4396-855d-abe56efd01ea tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:55.088313 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7c733974-1c37-4396-855d-abe56efd01ea tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:55.096588 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7c733974-1c37-4396-855d-abe56efd01ea tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.145209 Jun 22 09:20:55.097189 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 728/1410] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:54 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:56.114156 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-101e6aa3-a067-4672-9e91-04b3f88a8b56 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:56.114769 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-101e6aa3-a067-4672-9e91-04b3f88a8b56 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:56.117071 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=26 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:20:56.122452 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-101e6aa3-a067-4672-9e91-04b3f88a8b56 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:56.122899 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-101e6aa3-a067-4672-9e91-04b3f88a8b56 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:56.123659 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-101e6aa3-a067-4672-9e91-04b3f88a8b56 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:56.124085 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-101e6aa3-a067-4672-9e91-04b3f88a8b56 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:56.251191 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-101e6aa3-a067-4672-9e91-04b3f88a8b56 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:56.259168 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-101e6aa3-a067-4672-9e91-04b3f88a8b56 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.148964 Jun 22 09:20:56.259728 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 683/1411] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:56 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:57.277023 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-3f432464-043f-4341-84a2-b5df26c1d5aa tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:57.277667 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-3f432464-043f-4341-84a2-b5df26c1d5aa tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:57.284193 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3f432464-043f-4341-84a2-b5df26c1d5aa tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:57.284632 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3f432464-043f-4341-84a2-b5df26c1d5aa tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:57.285437 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3f432464-043f-4341-84a2-b5df26c1d5aa tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:57.285871 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3f432464-043f-4341-84a2-b5df26c1d5aa tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:57.414758 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-3f432464-043f-4341-84a2-b5df26c1d5aa tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:57.422891 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-3f432464-043f-4341-84a2-b5df26c1d5aa tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.149855 Jun 22 09:20:57.423462 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 729/1412] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:57 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:58.440197 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-7d197c41-a872-43b6-810e-7a136c4195f5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:58.440828 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-7d197c41-a872-43b6-810e-7a136c4195f5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:58.447468 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7d197c41-a872-43b6-810e-7a136c4195f5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:58.447912 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7d197c41-a872-43b6-810e-7a136c4195f5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:58.448667 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7d197c41-a872-43b6-810e-7a136c4195f5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:58.449124 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7d197c41-a872-43b6-810e-7a136c4195f5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:58.452128 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=78 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:20:58.578767 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-7d197c41-a872-43b6-810e-7a136c4195f5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:58.586895 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-7d197c41-a872-43b6-810e-7a136c4195f5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.150562 Jun 22 09:20:58.587469 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 684/1413] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:58 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:59.605082 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-0fc4cad4-222f-4f1d-b489-57af43fbaef9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:59.605705 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-0fc4cad4-222f-4f1d-b489-57af43fbaef9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:59.620992 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0fc4cad4-222f-4f1d-b489-57af43fbaef9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:59.621551 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0fc4cad4-222f-4f1d-b489-57af43fbaef9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:59.622244 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0fc4cad4-222f-4f1d-b489-57af43fbaef9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:59.622684 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0fc4cad4-222f-4f1d-b489-57af43fbaef9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:59.750347 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-0fc4cad4-222f-4f1d-b489-57af43fbaef9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:59.758401 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-0fc4cad4-222f-4f1d-b489-57af43fbaef9 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.157763 Jun 22 09:20:59.758960 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 730/1414] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:59 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:21:00.775440 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-5d7dc642-27ed-4a87-a9e0-9d745e5dc6c5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:21:00.776048 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-5d7dc642-27ed-4a87-a9e0-9d745e5dc6c5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:21:00.782865 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5d7dc642-27ed-4a87-a9e0-9d745e5dc6c5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:21:00.783312 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5d7dc642-27ed-4a87-a9e0-9d745e5dc6c5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:21:00.784064 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5d7dc642-27ed-4a87-a9e0-9d745e5dc6c5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:21:00.784498 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5d7dc642-27ed-4a87-a9e0-9d745e5dc6c5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:21:00.911200 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-5d7dc642-27ed-4a87-a9e0-9d745e5dc6c5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:21:00.919144 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-5d7dc642-27ed-4a87-a9e0-9d745e5dc6c5 tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.147547 Jun 22 09:21:00.919710 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 685/1415] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:21:00 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:21:01.936144 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f8ca0cfb-2549-4902-95db-c3b098e9f47d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:21:01.936730 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-f8ca0cfb-2549-4902-95db-c3b098e9f47d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] [instance: fb580ec8-80e7-4908-8761-08e8b136be42] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:21:01.943272 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f8ca0cfb-2549-4902-95db-c3b098e9f47d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:21:01.943727 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f8ca0cfb-2549-4902-95db-c3b098e9f47d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:21:01.944485 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f8ca0cfb-2549-4902-95db-c3b098e9f47d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:21:01.944956 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f8ca0cfb-2549-4902-95db-c3b098e9f47d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:21:02.075274 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-f8ca0cfb-2549-4902-95db-c3b098e9f47d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb1f75729d741928453fea5345938a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce1a6d223c14059b3ea7e07bfa1f577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:21:02.083726 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f8ca0cfb-2549-4902-95db-c3b098e9f47d tempest-VolumesSnapshotTestJSON-1169723824 tempest-VolumesSnapshotTestJSON-1169723824-project] 10.222.0.16 "GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42" status: 200 len: 1559 microversion: 2.1 time: 0.151624 Jun 22 09:21:02.084360 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 731/1416] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:21:01 2022] GET /compute/v2.1/servers/fb580ec8-80e7-4908-8761-08e8b136be42 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:21:39.191389 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:21:39.192072 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Wed Jun 22 09:21:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:22:37.663264 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR oslo.messaging._drivers.impl_rabbit [-] [37c3933e-4411-44e7-89c0-9c9368201568] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 22 09:22:37.664052 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=5 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:22:37.664802 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=11 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:22:37.668621 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-e1a86a64-fed4-43d7-b2ab-5b5f53177d3f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:22:37.669176 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-e1a86a64-fed4-43d7-b2ab-5b5f53177d3f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:22:37.675768 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e1a86a64-fed4-43d7-b2ab-5b5f53177d3f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:37.676222 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e1a86a64-fed4-43d7-b2ab-5b5f53177d3f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:37.677019 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e1a86a64-fed4-43d7-b2ab-5b5f53177d3f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:37.677462 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e1a86a64-fed4-43d7-b2ab-5b5f53177d3f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:37.704669 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-e1a86a64-fed4-43d7-b2ab-5b5f53177d3f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Going to try to terminate instance {{(pid=118024) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:22:37.890023 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e1a86a64-fed4-43d7-b2ab-5b5f53177d3f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [f6bad4da-1510-4133-90f0-157181a52a58] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 22 09:22:38.672055 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO oslo.messaging._drivers.impl_rabbit [-] [37c3933e-4411-44e7-89c0-9c9368201568] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 42148. Jun 22 09:22:38.896856 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO oslo.messaging._drivers.impl_rabbit [None req-e1a86a64-fed4-43d7-b2ab-5b5f53177d3f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [f6bad4da-1510-4133-90f0-157181a52a58] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 42152. Jun 22 09:22:38.986950 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-e1a86a64-fed4-43d7-b2ab-5b5f53177d3f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "DELETE /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 204 len: 0 microversion: 2.1 time: 1.325426 Jun 22 09:22:38.987553 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 686/1417] 10.222.0.16 () {58 vars in 1238 bytes} [Wed Jun 22 09:22:37 2022] DELETE /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 0 bytes in 1327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:22:38.994417 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR oslo.messaging._drivers.impl_rabbit [-] [464973eb-4c05-4793-ab21-ab2184288628] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 22 09:22:38.995252 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=15 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:22:38.996003 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=41 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:22:38.999917 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-087180d8-afb9-42a9-a1ce-fcceb3aa0103 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:22:39.000537 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-087180d8-afb9-42a9-a1ce-fcceb3aa0103 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:22:39.008166 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-087180d8-afb9-42a9-a1ce-fcceb3aa0103 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:39.008625 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-087180d8-afb9-42a9-a1ce-fcceb3aa0103 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:39.009467 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-087180d8-afb9-42a9-a1ce-fcceb3aa0103 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:39.009907 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-087180d8-afb9-42a9-a1ce-fcceb3aa0103 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:39.144976 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-087180d8-afb9-42a9-a1ce-fcceb3aa0103 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:22:39.152584 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-087180d8-afb9-42a9-a1ce-fcceb3aa0103 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1508 microversion: 2.1 time: 0.159944 Jun 22 09:22:39.153114 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 732/1418] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:22:38 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:22:40.171634 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-7cd27aaa-510f-4376-884a-b24ba3f7344f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:22:40.172328 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-7cd27aaa-510f-4376-884a-b24ba3f7344f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:22:40.179865 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7cd27aaa-510f-4376-884a-b24ba3f7344f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:40.180320 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7cd27aaa-510f-4376-884a-b24ba3f7344f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:40.181123 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7cd27aaa-510f-4376-884a-b24ba3f7344f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:40.181563 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7cd27aaa-510f-4376-884a-b24ba3f7344f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:40.381663 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-7cd27aaa-510f-4376-884a-b24ba3f7344f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:22:40.389533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-7cd27aaa-510f-4376-884a-b24ba3f7344f tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1508 microversion: 2.1 time: 0.222155 Jun 22 09:22:40.390191 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 687/1419] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:22:40 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1508 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:22:40.946019 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO oslo.messaging._drivers.impl_rabbit [-] [464973eb-4c05-4793-ab21-ab2184288628] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 42184. Jun 22 09:22:40.999429 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-284582dd-ccd6-4bd5-93d0-94fadee69d10 req-c2b9ccf8-b6e7-425b-bd4a-6c50b6f5683c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "699207bb-360b-451e-85ee-a5cc21227d44", "name": "network-vif-deleted", "tag": "795afac5-e2d6-479f-b9e5-8f401a2994c0"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:22:41.008483 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-284582dd-ccd6-4bd5-93d0-94fadee69d10 req-c2b9ccf8-b6e7-425b-bd4a-6c50b6f5683c service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:41.008955 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-284582dd-ccd6-4bd5-93d0-94fadee69d10 req-c2b9ccf8-b6e7-425b-bd4a-6c50b6f5683c service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:41.023750 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-284582dd-ccd6-4bd5-93d0-94fadee69d10 req-c2b9ccf8-b6e7-425b-bd4a-6c50b6f5683c service nova] Creating event network-vif-deleted:795afac5-e2d6-479f-b9e5-8f401a2994c0 for instance 699207bb-360b-451e-85ee-a5cc21227d44 on hv-cinder-84599 Jun 22 09:22:41.029892 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-284582dd-ccd6-4bd5-93d0-94fadee69d10 req-c2b9ccf8-b6e7-425b-bd4a-6c50b6f5683c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096043 Jun 22 09:22:41.030512 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 733/1420] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:22:41.407042 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-09805dce-d7fd-4ee9-b905-3e40d0d44004 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:22:41.407731 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-09805dce-d7fd-4ee9-b905-3e40d0d44004 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:22:41.414628 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-09805dce-d7fd-4ee9-b905-3e40d0d44004 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:41.416496 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-09805dce-d7fd-4ee9-b905-3e40d0d44004 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:41.416496 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-09805dce-d7fd-4ee9-b905-3e40d0d44004 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:41.416496 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-09805dce-d7fd-4ee9-b905-3e40d0d44004 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:41.447879 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-09805dce-d7fd-4ee9-b905-3e40d0d44004 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:41.448329 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-09805dce-d7fd-4ee9-b905-3e40d0d44004 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:41.448843 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.objects.instance [None req-09805dce-d7fd-4ee9-b905-3e40d0d44004 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lazy-loading 'fault' on Instance uuid 699207bb-360b-451e-85ee-a5cc21227d44 {{(pid=118024) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:22:41.491073 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-09805dce-d7fd-4ee9-b905-3e40d0d44004 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:22:41.498480 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-09805dce-d7fd-4ee9-b905-3e40d0d44004 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 200 len: 1312 microversion: 2.1 time: 0.095647 Jun 22 09:22:41.499042 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 688/1421] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:22:41 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:22:42.517913 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d8e75108-6041-46f3-af88-6262fef538fe tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:22:42.518607 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-d8e75108-6041-46f3-af88-6262fef538fe tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 699207bb-360b-451e-85ee-a5cc21227d44] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:22:42.524808 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d8e75108-6041-46f3-af88-6262fef538fe tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:42.525267 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d8e75108-6041-46f3-af88-6262fef538fe tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:42.526015 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d8e75108-6041-46f3-af88-6262fef538fe tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:42.526448 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d8e75108-6041-46f3-af88-6262fef538fe tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:42.539417 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.wsgi [None req-d8e75108-6041-46f3-af88-6262fef538fe tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] HTTP exception thrown: Instance 699207bb-360b-451e-85ee-a5cc21227d44 could not be found. Jun 22 09:22:42.541035 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d8e75108-6041-46f3-af88-6262fef538fe tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Request method failure captured: Jun 22 09:22:42.541035 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: request: GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 HTTP/1.1 Jun 22 09:22:42.541035 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept: application/json Jun 22 09:22:42.541035 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept-Encoding: identity Jun 22 09:22:42.541035 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Connection: close Jun 22 09:22:42.541035 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Length: 0 Jun 22 09:22:42.541035 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Type: application/json Jun 22 09:22:42.541035 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Host: 10.222.0.16 Jun 22 09:22:42.541035 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Openstack-System-Scope: None Jun 22 09:22:42.541035 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: User-Agent: python-urllib3/1.26.9 Jun 22 09:22:42.541035 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Auth-Token: gAAAAABistmkRR_A1SSd_DKSdmLeXfCgq8S7MTDoc5Rg_dVzj7V0Sq8HIViMmjLNjckKM4J6xg-gPY3gbXMfQytoblh_gdFPbQnFzcj16rPlrzeTOqehoqqd-eW8nblkxMTRUaTWCfvbJOUsQ24LDqfB-k6flQr9yIlEFcuMAVjS-zMIg2TYx34 Jun 22 09:22:42.541035 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Id: None Jun 22 09:22:42.541035 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Name: None Jun 22 09:22:42.541035 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Identity-Status: Confirmed Jun 22 09:22:42.541035 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Is-Admin-Project: True Jun 22 09:22:42.541035 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Id: default Jun 22 09:22:42.541035 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Name: Default Jun 22 09:22:42.541035 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Id: 4019eed8f0a140f099ca1c123ff71cef Jun 22 09:22:42.541035 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1606992120 Jun 22 09:22:42.541035 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Role: member,reader Jun 22 09:22:42.541035 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Roles: member,reader Jun 22 09:22:42.542812 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4019eed8f0a140f099ca1c123ff71cef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4019eed8f0a140f099ca1c123ff71cef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4019eed8f0a140f099ca1c123ff71cef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4019eed8f0a140f099ca1c123ff71cef", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:22:42.542812 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1606992120 Jun 22 09:22:42.542812 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Id: 4019eed8f0a140f099ca1c123ff71cef Jun 22 09:22:42.542812 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1606992120 Jun 22 09:22:42.542812 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User: tempest-ServerRescueNegativeTestJSON-1606992120-project Jun 22 09:22:42.542812 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Id: default Jun 22 09:22:42.542812 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Name: Default Jun 22 09:22:42.542812 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Id: 1a8d3cd247d743cf8c93ee15d8574602 Jun 22 09:22:42.542812 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1606992120-project Jun 22 09:22:42.542812 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: method: > Jun 22 09:22:42.542812 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: exception: Instance 699207bb-360b-451e-85ee-a5cc21227d44 could not be found. Jun 22 09:22:42.542812 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: action_args: {'id': '699207bb-360b-451e-85ee-a5cc21227d44'} Jun 22 09:22:42.543785 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:22:42.543785 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:22:42.543785 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:22:42.543785 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:22:42.543785 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:22:42.543785 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:22:42.543785 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:22:42.543785 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:22:42.543785 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:22:42.543785 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:22:42.543785 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 699207bb-360b-451e-85ee-a5cc21227d44 could not be found. Jun 22 09:22:42.543785 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:22:42.543785 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:22:42.543785 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:22:42.543785 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:22:42.543785 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:22:42.543785 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:22:42.543785 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:22:42.543785 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:22:42.543785 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:22:42.545262 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:22:42.545262 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:22:42.545262 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:22:42.545262 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:22:42.545262 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:22:42.545262 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:22:42.545262 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:22:42.545262 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 699207bb-360b-451e-85ee-a5cc21227d44 could not be found. Jun 22 09:22:42.545262 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:22:42.545262 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:22:42.545262 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:22:42.545262 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:22:42.545262 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:22:42.545262 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:22:42.545262 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:22:42.545262 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:22:42.545262 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 699207bb-360b-451e-85ee-a5cc21227d44 could not be found. Jun 22 09:22:42.545262 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:22:42.547463 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d8e75108-6041-46f3-af88-6262fef538fe tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Returning 404 to user: Instance 699207bb-360b-451e-85ee-a5cc21227d44 could not be found. {{(pid=118025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:22:42.547463 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d8e75108-6041-46f3-af88-6262fef538fe tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44" status: 404 len: 111 microversion: 2.1 time: 0.029900 Jun 22 09:22:42.547463 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 734/1422] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:22:42 2022] GET /compute/v2.1/servers/699207bb-360b-451e-85ee-a5cc21227d44 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:22:42.551959 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-44070da7-3f9c-42b8-afbc-e7eccf28ce22 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:22:42.552482 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-44070da7-3f9c-42b8-afbc-e7eccf28ce22 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:22:42.558872 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-44070da7-3f9c-42b8-afbc-e7eccf28ce22 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:42.559321 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-44070da7-3f9c-42b8-afbc-e7eccf28ce22 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:42.560080 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-44070da7-3f9c-42b8-afbc-e7eccf28ce22 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:42.560520 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-44070da7-3f9c-42b8-afbc-e7eccf28ce22 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:42.585660 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-44070da7-3f9c-42b8-afbc-e7eccf28ce22 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Going to try to terminate instance {{(pid=118024) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:22:42.905531 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-44070da7-3f9c-42b8-afbc-e7eccf28ce22 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "DELETE /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 204 len: 0 microversion: 2.1 time: 0.357960 Jun 22 09:22:42.906827 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 689/1423] 10.222.0.16 () {58 vars in 1238 bytes} [Wed Jun 22 09:22:42 2022] DELETE /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:22:42.919887 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-68277435-94ce-47ce-a115-d7bacc4fe032 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:22:42.920710 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-68277435-94ce-47ce-a115-d7bacc4fe032 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:22:42.928852 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-68277435-94ce-47ce-a115-d7bacc4fe032 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:42.929314 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-68277435-94ce-47ce-a115-d7bacc4fe032 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:42.930102 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-68277435-94ce-47ce-a115-d7bacc4fe032 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:42.930547 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-68277435-94ce-47ce-a115-d7bacc4fe032 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:43.062197 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-68277435-94ce-47ce-a115-d7bacc4fe032 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:22:43.069605 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-68277435-94ce-47ce-a115-d7bacc4fe032 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.153678 Jun 22 09:22:43.070153 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 735/1424] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:22:42 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:22:44.088496 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-dc5e13fc-df68-4f8d-8f10-b2635d88ae5a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:22:44.089170 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-dc5e13fc-df68-4f8d-8f10-b2635d88ae5a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:22:44.095707 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dc5e13fc-df68-4f8d-8f10-b2635d88ae5a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:44.096161 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dc5e13fc-df68-4f8d-8f10-b2635d88ae5a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:44.099092 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dc5e13fc-df68-4f8d-8f10-b2635d88ae5a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:44.099092 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dc5e13fc-df68-4f8d-8f10-b2635d88ae5a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:44.233680 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-dc5e13fc-df68-4f8d-8f10-b2635d88ae5a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:22:44.242621 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-dc5e13fc-df68-4f8d-8f10-b2635d88ae5a tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1521 microversion: 2.1 time: 0.158506 Jun 22 09:22:44.244502 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 690/1425] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:22:44 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:22:44.361787 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-bbf957f0-18f9-44c3-b1cd-6ee8cdfa755e req-614a0e65-48ec-4dd4-8571-92596c682894 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "713f284f-527e-4246-a442-f2d8a32428d5", "name": "network-vif-deleted", "tag": "a3826696-5f1e-4efc-8516-fc2d14d29e17"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:22:44.370297 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-bbf957f0-18f9-44c3-b1cd-6ee8cdfa755e req-614a0e65-48ec-4dd4-8571-92596c682894 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:44.370734 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-bbf957f0-18f9-44c3-b1cd-6ee8cdfa755e req-614a0e65-48ec-4dd4-8571-92596c682894 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:44.382130 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-bbf957f0-18f9-44c3-b1cd-6ee8cdfa755e req-614a0e65-48ec-4dd4-8571-92596c682894 service nova] Creating event network-vif-deleted:a3826696-5f1e-4efc-8516-fc2d14d29e17 for instance 713f284f-527e-4246-a442-f2d8a32428d5 on hv-cinder-84599 Jun 22 09:22:44.387359 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-bbf957f0-18f9-44c3-b1cd-6ee8cdfa755e req-614a0e65-48ec-4dd4-8571-92596c682894 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030585 Jun 22 09:22:44.388018 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 736/1426] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:22:45.259684 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-e18f1d30-8598-4439-9e8f-30791b717b73 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:22:45.260298 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-e18f1d30-8598-4439-9e8f-30791b717b73 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:22:45.267698 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e18f1d30-8598-4439-9e8f-30791b717b73 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:45.268193 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e18f1d30-8598-4439-9e8f-30791b717b73 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:45.269030 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e18f1d30-8598-4439-9e8f-30791b717b73 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:45.269473 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e18f1d30-8598-4439-9e8f-30791b717b73 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:45.304004 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e18f1d30-8598-4439-9e8f-30791b717b73 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:45.305529 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e18f1d30-8598-4439-9e8f-30791b717b73 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:45.305988 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.objects.instance [None req-e18f1d30-8598-4439-9e8f-30791b717b73 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lazy-loading 'fault' on Instance uuid 713f284f-527e-4246-a442-f2d8a32428d5 {{(pid=118024) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:22:45.349713 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-e18f1d30-8598-4439-9e8f-30791b717b73 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a8d3cd247d743cf8c93ee15d8574602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4019eed8f0a140f099ca1c123ff71cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:22:45.356491 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-e18f1d30-8598-4439-9e8f-30791b717b73 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 200 len: 1311 microversion: 2.1 time: 0.101020 Jun 22 09:22:45.357082 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 691/1427] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:22:45 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:22:46.381402 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-30d8d596-c8ea-48e5-a100-16ec2f417ed1 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:22:46.382457 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-30d8d596-c8ea-48e5-a100-16ec2f417ed1 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] [instance: 713f284f-527e-4246-a442-f2d8a32428d5] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:22:46.389273 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-30d8d596-c8ea-48e5-a100-16ec2f417ed1 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:46.389725 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-30d8d596-c8ea-48e5-a100-16ec2f417ed1 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:46.390492 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-30d8d596-c8ea-48e5-a100-16ec2f417ed1 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:46.390932 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-30d8d596-c8ea-48e5-a100-16ec2f417ed1 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:46.404337 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.wsgi [None req-30d8d596-c8ea-48e5-a100-16ec2f417ed1 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] HTTP exception thrown: Instance 713f284f-527e-4246-a442-f2d8a32428d5 could not be found. Jun 22 09:22:46.406004 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-30d8d596-c8ea-48e5-a100-16ec2f417ed1 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Request method failure captured: Jun 22 09:22:46.406004 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: request: GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 HTTP/1.1 Jun 22 09:22:46.406004 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept: application/json Jun 22 09:22:46.406004 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept-Encoding: identity Jun 22 09:22:46.406004 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Connection: close Jun 22 09:22:46.406004 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Length: 0 Jun 22 09:22:46.406004 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Type: application/json Jun 22 09:22:46.406004 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Host: 10.222.0.16 Jun 22 09:22:46.406004 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Openstack-System-Scope: None Jun 22 09:22:46.406004 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: User-Agent: python-urllib3/1.26.9 Jun 22 09:22:46.406004 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Auth-Token: gAAAAABistmkRR_A1SSd_DKSdmLeXfCgq8S7MTDoc5Rg_dVzj7V0Sq8HIViMmjLNjckKM4J6xg-gPY3gbXMfQytoblh_gdFPbQnFzcj16rPlrzeTOqehoqqd-eW8nblkxMTRUaTWCfvbJOUsQ24LDqfB-k6flQr9yIlEFcuMAVjS-zMIg2TYx34 Jun 22 09:22:46.406004 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Id: None Jun 22 09:22:46.406004 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Name: None Jun 22 09:22:46.406004 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Identity-Status: Confirmed Jun 22 09:22:46.406004 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Is-Admin-Project: True Jun 22 09:22:46.406004 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Id: default Jun 22 09:22:46.406004 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Name: Default Jun 22 09:22:46.406004 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Id: 4019eed8f0a140f099ca1c123ff71cef Jun 22 09:22:46.406004 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1606992120 Jun 22 09:22:46.406004 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Role: member,reader Jun 22 09:22:46.406004 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Roles: member,reader Jun 22 09:22:46.407941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4019eed8f0a140f099ca1c123ff71cef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4019eed8f0a140f099ca1c123ff71cef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4019eed8f0a140f099ca1c123ff71cef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4019eed8f0a140f099ca1c123ff71cef", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:22:46.407941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1606992120 Jun 22 09:22:46.407941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Id: 4019eed8f0a140f099ca1c123ff71cef Jun 22 09:22:46.407941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1606992120 Jun 22 09:22:46.407941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User: tempest-ServerRescueNegativeTestJSON-1606992120-project Jun 22 09:22:46.407941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Id: default Jun 22 09:22:46.407941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Name: Default Jun 22 09:22:46.407941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Id: 1a8d3cd247d743cf8c93ee15d8574602 Jun 22 09:22:46.407941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1606992120-project Jun 22 09:22:46.407941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: method: > Jun 22 09:22:46.407941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: exception: Instance 713f284f-527e-4246-a442-f2d8a32428d5 could not be found. Jun 22 09:22:46.407941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: action_args: {'id': '713f284f-527e-4246-a442-f2d8a32428d5'} Jun 22 09:22:46.409016 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:22:46.409016 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:22:46.409016 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:22:46.409016 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:22:46.409016 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:22:46.409016 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:22:46.409016 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:22:46.409016 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:22:46.409016 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:22:46.409016 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:22:46.409016 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 713f284f-527e-4246-a442-f2d8a32428d5 could not be found. Jun 22 09:22:46.409016 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:22:46.409016 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:22:46.409016 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:22:46.409016 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:22:46.409016 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:22:46.409016 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:22:46.409016 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:22:46.409016 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:22:46.409016 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:22:46.410697 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:22:46.410697 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:22:46.410697 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:22:46.410697 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:22:46.410697 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:22:46.410697 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:22:46.410697 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:22:46.410697 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 713f284f-527e-4246-a442-f2d8a32428d5 could not be found. Jun 22 09:22:46.410697 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:22:46.410697 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:22:46.410697 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:22:46.410697 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:22:46.410697 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:22:46.410697 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:22:46.410697 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:22:46.410697 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:22:46.410697 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 713f284f-527e-4246-a442-f2d8a32428d5 could not be found. Jun 22 09:22:46.410697 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:22:46.412256 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-30d8d596-c8ea-48e5-a100-16ec2f417ed1 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] Returning 404 to user: Instance 713f284f-527e-4246-a442-f2d8a32428d5 could not be found. {{(pid=118025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:22:46.412256 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-30d8d596-c8ea-48e5-a100-16ec2f417ed1 tempest-ServerRescueNegativeTestJSON-1606992120 tempest-ServerRescueNegativeTestJSON-1606992120-project] 10.222.0.16 "GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5" status: 404 len: 111 microversion: 2.1 time: 0.031880 Jun 22 09:22:46.412256 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 737/1428] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:22:46 2022] GET /compute/v2.1/servers/713f284f-527e-4246-a442-f2d8a32428d5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:22:54.366780 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:22:54.367256 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Wed Jun 22 09:22:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:23:13.305210 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:23:13.305744 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Wed Jun 22 09:23:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:23:17.114526 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:23:17.115158 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Wed Jun 22 09:23:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:23:42.629885 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-0aee7503-5b5d-49d6-b570-2f4588d9df0a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:23:42.630486 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-0aee7503-5b5d-49d6-b570-2f4588d9df0a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: 626992c9-801c-488f-98ca-253f69a7d46f] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:23:42.633818 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=2 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:42.634818 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:42.638883 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0aee7503-5b5d-49d6-b570-2f4588d9df0a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:23:42.639337 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0aee7503-5b5d-49d6-b570-2f4588d9df0a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:23:42.640106 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0aee7503-5b5d-49d6-b570-2f4588d9df0a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:23:42.640645 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0aee7503-5b5d-49d6-b570-2f4588d9df0a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:23:42.654128 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.wsgi [None req-0aee7503-5b5d-49d6-b570-2f4588d9df0a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] HTTP exception thrown: Instance 626992c9-801c-488f-98ca-253f69a7d46f could not be found. Jun 22 09:23:42.655841 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-0aee7503-5b5d-49d6-b570-2f4588d9df0a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Request method failure captured: Jun 22 09:23:42.655841 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: request: DELETE /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f HTTP/1.1 Jun 22 09:23:42.655841 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept: application/json Jun 22 09:23:42.655841 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept-Encoding: identity Jun 22 09:23:42.655841 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Connection: close Jun 22 09:23:42.655841 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Length: 0 Jun 22 09:23:42.655841 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Type: application/json Jun 22 09:23:42.655841 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Host: 10.222.0.16 Jun 22 09:23:42.655841 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Openstack-System-Scope: None Jun 22 09:23:42.655841 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: User-Agent: python-urllib3/1.26.9 Jun 22 09:23:42.655841 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Auth-Token: gAAAAABistmshaECFGAHnRmYa6rYBXSOVD0Qua4uTG5avt1MhcK74DWY3z7j33DyNyPUEHkNAlpnveIdxiQXR4PVctEysp2-oZYhmBZfOkICvSxCioSV-tQOnSDfZ3AGE3xsfOtBMU0bgwdFz6BzWaVEfy2YGlGG8lqZlzBcaQ5nCEgZDL5ggws Jun 22 09:23:42.655841 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Id: None Jun 22 09:23:42.655841 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Name: None Jun 22 09:23:42.655841 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Identity-Status: Confirmed Jun 22 09:23:42.655841 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Is-Admin-Project: True Jun 22 09:23:42.655841 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 09:23:42.655841 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Id: default Jun 22 09:23:42.655841 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Name: Default Jun 22 09:23:42.655841 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Id: b172c496b3304444bd6169a09cff85d2 Jun 22 09:23:42.655841 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2111643669 Jun 22 09:23:42.655841 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Role: member,reader Jun 22 09:23:42.655841 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Roles: member,reader Jun 22 09:23:42.660878 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b172c496b3304444bd6169a09cff85d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b172c496b3304444bd6169a09cff85d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b172c496b3304444bd6169a09cff85d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b172c496b3304444bd6169a09cff85d2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:23:42.660878 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2111643669 Jun 22 09:23:42.660878 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Id: b172c496b3304444bd6169a09cff85d2 Jun 22 09:23:42.660878 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2111643669 Jun 22 09:23:42.660878 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User: tempest-AttachVolumeShelveTestJSON-2111643669-project Jun 22 09:23:42.660878 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Id: default Jun 22 09:23:42.660878 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Name: Default Jun 22 09:23:42.660878 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Id: dc534f42584b4e57a4706c81729cacd5 Jun 22 09:23:42.660878 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2111643669-project Jun 22 09:23:42.660878 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: method: > Jun 22 09:23:42.660878 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: exception: Instance 626992c9-801c-488f-98ca-253f69a7d46f could not be found. Jun 22 09:23:42.660878 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: action_args: {'id': '626992c9-801c-488f-98ca-253f69a7d46f'} Jun 22 09:23:42.661923 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:23:42.661923 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:23:42.661923 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:23:42.661923 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:23:42.661923 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:23:42.661923 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:23:42.661923 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:23:42.661923 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:23:42.661923 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:23:42.661923 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:23:42.661923 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 626992c9-801c-488f-98ca-253f69a7d46f could not be found. Jun 22 09:23:42.661923 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:23:42.661923 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:23:42.661923 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:23:42.661923 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:23:42.661923 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:23:42.661923 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:23:42.661923 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:23:42.661923 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:23:42.661923 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:23:42.663764 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:23:42.663764 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 09:23:42.663764 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 09:23:42.663764 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 09:23:42.663764 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 09:23:42.663764 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:23:42.663764 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:23:42.663764 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:23:42.663764 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:23:42.663764 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 626992c9-801c-488f-98ca-253f69a7d46f could not be found. Jun 22 09:23:42.663764 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:23:42.663764 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:23:42.663764 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:23:42.663764 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:23:42.663764 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:23:42.663764 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:23:42.663764 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:23:42.663764 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:23:42.663764 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 626992c9-801c-488f-98ca-253f69a7d46f could not be found. Jun 22 09:23:42.663764 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:23:42.665907 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-0aee7503-5b5d-49d6-b570-2f4588d9df0a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Returning 404 to user: Instance 626992c9-801c-488f-98ca-253f69a7d46f could not be found. {{(pid=118024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:23:42.665907 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-0aee7503-5b5d-49d6-b570-2f4588d9df0a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "DELETE /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f" status: 404 len: 111 microversion: 2.20 time: 0.031498 Jun 22 09:23:42.665907 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 692/1429] 10.222.0.16 () {60 vars in 1279 bytes} [Wed Jun 22 09:23:42 2022] DELETE /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 09:23:42.672052 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2f9132df-a1b5-4def-bb9b-0f554d83117a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:23:42.672662 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2f9132df-a1b5-4def-bb9b-0f554d83117a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: 626992c9-801c-488f-98ca-253f69a7d46f] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:23:42.675054 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=12 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:42.675708 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=20 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:42.680393 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2f9132df-a1b5-4def-bb9b-0f554d83117a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:23:42.682447 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2f9132df-a1b5-4def-bb9b-0f554d83117a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:23:42.682447 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2f9132df-a1b5-4def-bb9b-0f554d83117a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:23:42.682447 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2f9132df-a1b5-4def-bb9b-0f554d83117a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:23:42.695796 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.wsgi [None req-2f9132df-a1b5-4def-bb9b-0f554d83117a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] HTTP exception thrown: Instance 626992c9-801c-488f-98ca-253f69a7d46f could not be found. Jun 22 09:23:42.697342 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2f9132df-a1b5-4def-bb9b-0f554d83117a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Request method failure captured: Jun 22 09:23:42.697342 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: request: GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f HTTP/1.1 Jun 22 09:23:42.697342 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept: application/json Jun 22 09:23:42.697342 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept-Encoding: identity Jun 22 09:23:42.697342 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Connection: close Jun 22 09:23:42.697342 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Length: 0 Jun 22 09:23:42.697342 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Type: application/json Jun 22 09:23:42.697342 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Host: 10.222.0.16 Jun 22 09:23:42.697342 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Openstack-System-Scope: None Jun 22 09:23:42.697342 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: User-Agent: python-urllib3/1.26.9 Jun 22 09:23:42.697342 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Auth-Token: gAAAAABistmshaECFGAHnRmYa6rYBXSOVD0Qua4uTG5avt1MhcK74DWY3z7j33DyNyPUEHkNAlpnveIdxiQXR4PVctEysp2-oZYhmBZfOkICvSxCioSV-tQOnSDfZ3AGE3xsfOtBMU0bgwdFz6BzWaVEfy2YGlGG8lqZlzBcaQ5nCEgZDL5ggws Jun 22 09:23:42.697342 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Id: None Jun 22 09:23:42.697342 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Name: None Jun 22 09:23:42.697342 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Identity-Status: Confirmed Jun 22 09:23:42.697342 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Is-Admin-Project: True Jun 22 09:23:42.697342 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 09:23:42.697342 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Id: default Jun 22 09:23:42.697342 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Name: Default Jun 22 09:23:42.697342 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Id: b172c496b3304444bd6169a09cff85d2 Jun 22 09:23:42.697342 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2111643669 Jun 22 09:23:42.697342 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Role: member,reader Jun 22 09:23:42.697342 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Roles: member,reader Jun 22 09:23:42.699160 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b172c496b3304444bd6169a09cff85d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b172c496b3304444bd6169a09cff85d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b172c496b3304444bd6169a09cff85d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b172c496b3304444bd6169a09cff85d2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:23:42.699160 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2111643669 Jun 22 09:23:42.699160 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Id: b172c496b3304444bd6169a09cff85d2 Jun 22 09:23:42.699160 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2111643669 Jun 22 09:23:42.699160 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User: tempest-AttachVolumeShelveTestJSON-2111643669-project Jun 22 09:23:42.699160 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Id: default Jun 22 09:23:42.699160 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Name: Default Jun 22 09:23:42.699160 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Id: dc534f42584b4e57a4706c81729cacd5 Jun 22 09:23:42.699160 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2111643669-project Jun 22 09:23:42.699160 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: method: > Jun 22 09:23:42.699160 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: exception: Instance 626992c9-801c-488f-98ca-253f69a7d46f could not be found. Jun 22 09:23:42.699160 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: action_args: {'id': '626992c9-801c-488f-98ca-253f69a7d46f'} Jun 22 09:23:42.700173 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:23:42.700173 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:23:42.700173 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:23:42.700173 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:23:42.700173 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:23:42.700173 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:23:42.700173 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:23:42.700173 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:23:42.700173 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:23:42.700173 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:23:42.700173 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 626992c9-801c-488f-98ca-253f69a7d46f could not be found. Jun 22 09:23:42.700173 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:23:42.700173 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:23:42.700173 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:23:42.700173 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:23:42.700173 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:23:42.700173 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:23:42.700173 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:23:42.700173 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:23:42.700173 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:23:42.701941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:23:42.701941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:23:42.701941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:23:42.701941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:23:42.701941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:23:42.701941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:23:42.701941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:23:42.701941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 626992c9-801c-488f-98ca-253f69a7d46f could not be found. Jun 22 09:23:42.701941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:23:42.701941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:23:42.701941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:23:42.701941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:23:42.701941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:23:42.701941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:23:42.701941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:23:42.701941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:23:42.701941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 626992c9-801c-488f-98ca-253f69a7d46f could not be found. Jun 22 09:23:42.701941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:23:42.703471 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2f9132df-a1b5-4def-bb9b-0f554d83117a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Returning 404 to user: Instance 626992c9-801c-488f-98ca-253f69a7d46f could not be found. {{(pid=118025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:23:42.703471 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2f9132df-a1b5-4def-bb9b-0f554d83117a tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f" status: 404 len: 111 microversion: 2.20 time: 0.031392 Jun 22 09:23:42.703471 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 738/1430] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 09:23:42 2022] GET /compute/v2.1/servers/626992c9-801c-488f-98ca-253f69a7d46f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 09:23:56.220116 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-8b42bb6f-4fe8-485e-9a32-4316b74d4f33 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:23:56.220617 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-8b42bb6f-4fe8-485e-9a32-4316b74d4f33 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:23:56.228439 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8b42bb6f-4fe8-485e-9a32-4316b74d4f33 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:23:56.228922 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8b42bb6f-4fe8-485e-9a32-4316b74d4f33 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:23:56.229687 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8b42bb6f-4fe8-485e-9a32-4316b74d4f33 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:23:56.230125 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8b42bb6f-4fe8-485e-9a32-4316b74d4f33 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:23:56.256093 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-8b42bb6f-4fe8-485e-9a32-4316b74d4f33 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Going to try to terminate instance {{(pid=118024) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:23:56.568529 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-8b42bb6f-4fe8-485e-9a32-4316b74d4f33 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 204 len: 0 microversion: 2.1 time: 0.352852 Jun 22 09:23:56.569144 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 693/1431] 10.222.0.16 () {58 vars in 1238 bytes} [Wed Jun 22 09:23:56 2022] DELETE /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:23:56.578391 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-1b4e866d-7faa-4f63-8ad6-2ea985640328 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:23:56.578996 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-1b4e866d-7faa-4f63-8ad6-2ea985640328 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:23:56.585871 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1b4e866d-7faa-4f63-8ad6-2ea985640328 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:23:56.586314 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1b4e866d-7faa-4f63-8ad6-2ea985640328 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:23:56.587072 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1b4e866d-7faa-4f63-8ad6-2ea985640328 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:23:56.587510 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1b4e866d-7faa-4f63-8ad6-2ea985640328 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:23:56.715332 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-1b4e866d-7faa-4f63-8ad6-2ea985640328 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:23:56.723879 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-1b4e866d-7faa-4f63-8ad6-2ea985640328 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1720 microversion: 2.1 time: 0.150419 Jun 22 09:23:56.724428 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 739/1432] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:23:56 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:23:57.742041 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b113ee4b-84fc-482d-8aa2-b25ab8fb568f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:23:57.742741 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-b113ee4b-84fc-482d-8aa2-b25ab8fb568f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:23:57.749720 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b113ee4b-84fc-482d-8aa2-b25ab8fb568f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:23:57.750174 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b113ee4b-84fc-482d-8aa2-b25ab8fb568f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:23:57.750951 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b113ee4b-84fc-482d-8aa2-b25ab8fb568f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:23:57.751391 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b113ee4b-84fc-482d-8aa2-b25ab8fb568f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:23:57.886777 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-b113ee4b-84fc-482d-8aa2-b25ab8fb568f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:23:57.895443 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-b113ee4b-84fc-482d-8aa2-b25ab8fb568f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1720 microversion: 2.1 time: 0.157650 Jun 22 09:23:57.896027 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 694/1433] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:23:57 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:23:58.865640 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-7689e188-ed27-4579-983b-e00d18c2f24d req-e46540c0-1777-4999-b1d1-66c5c50ca9f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b84e6922-9b60-4a6d-8836-4b07ef206590", "name": "network-vif-deleted", "tag": "e4f8b1de-c427-4428-a8a5-28fa99c60cba"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:23:58.874213 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-7689e188-ed27-4579-983b-e00d18c2f24d req-e46540c0-1777-4999-b1d1-66c5c50ca9f6 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:23:58.874667 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-7689e188-ed27-4579-983b-e00d18c2f24d req-e46540c0-1777-4999-b1d1-66c5c50ca9f6 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:23:58.886297 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-7689e188-ed27-4579-983b-e00d18c2f24d req-e46540c0-1777-4999-b1d1-66c5c50ca9f6 service nova] Creating event network-vif-deleted:e4f8b1de-c427-4428-a8a5-28fa99c60cba for instance b84e6922-9b60-4a6d-8836-4b07ef206590 on hv-cinder-84599 Jun 22 09:23:58.891981 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-7689e188-ed27-4579-983b-e00d18c2f24d req-e46540c0-1777-4999-b1d1-66c5c50ca9f6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029955 Jun 22 09:23:58.892570 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 740/1434] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:23:58.913701 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-eae7fcac-b440-4bc0-85fd-9708c4a3889c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:23:58.914487 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-eae7fcac-b440-4bc0-85fd-9708c4a3889c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:23:58.923262 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-eae7fcac-b440-4bc0-85fd-9708c4a3889c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:23:58.924064 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-eae7fcac-b440-4bc0-85fd-9708c4a3889c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:23:58.925100 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-eae7fcac-b440-4bc0-85fd-9708c4a3889c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:23:58.925586 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-eae7fcac-b440-4bc0-85fd-9708c4a3889c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:23:58.992181 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-eae7fcac-b440-4bc0-85fd-9708c4a3889c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:23:59.003371 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-eae7fcac-b440-4bc0-85fd-9708c4a3889c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1652 microversion: 2.1 time: 0.093161 Jun 22 09:23:59.011455 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 695/1435] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:23:58 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1652 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:00.022953 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-567220bf-22eb-478c-b65d-0de59064824b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:00.023651 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-567220bf-22eb-478c-b65d-0de59064824b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:00.030484 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-567220bf-22eb-478c-b65d-0de59064824b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:00.030960 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-567220bf-22eb-478c-b65d-0de59064824b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:00.031723 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-567220bf-22eb-478c-b65d-0de59064824b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:00.032158 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-567220bf-22eb-478c-b65d-0de59064824b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:00.093016 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-567220bf-22eb-478c-b65d-0de59064824b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:00.100907 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-567220bf-22eb-478c-b65d-0de59064824b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082683 Jun 22 09:24:00.101461 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 741/1436] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:00 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:01.118492 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-06fd9ddd-dea7-4ba5-be15-2e2f987e3745 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:01.119104 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-06fd9ddd-dea7-4ba5-be15-2e2f987e3745 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:01.126437 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-06fd9ddd-dea7-4ba5-be15-2e2f987e3745 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:01.127143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-06fd9ddd-dea7-4ba5-be15-2e2f987e3745 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:01.127898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-06fd9ddd-dea7-4ba5-be15-2e2f987e3745 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:01.128332 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-06fd9ddd-dea7-4ba5-be15-2e2f987e3745 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:01.188080 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-06fd9ddd-dea7-4ba5-be15-2e2f987e3745 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:01.196116 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-06fd9ddd-dea7-4ba5-be15-2e2f987e3745 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081434 Jun 22 09:24:01.196679 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 696/1437] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:01 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:02.214481 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-72f32e54-152d-413b-960c-7f27ef26a940 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:02.214481 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-72f32e54-152d-413b-960c-7f27ef26a940 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:02.221078 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-72f32e54-152d-413b-960c-7f27ef26a940 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:02.221521 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-72f32e54-152d-413b-960c-7f27ef26a940 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:02.222281 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-72f32e54-152d-413b-960c-7f27ef26a940 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:02.222713 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-72f32e54-152d-413b-960c-7f27ef26a940 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:02.287241 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-72f32e54-152d-413b-960c-7f27ef26a940 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:02.295165 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-72f32e54-152d-413b-960c-7f27ef26a940 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.085245 Jun 22 09:24:02.295714 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 742/1438] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:02 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:03.311610 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-8782bf9b-2679-437f-8143-e1b50a7b3bb2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:03.312225 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-8782bf9b-2679-437f-8143-e1b50a7b3bb2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:03.318729 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8782bf9b-2679-437f-8143-e1b50a7b3bb2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:03.319181 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8782bf9b-2679-437f-8143-e1b50a7b3bb2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:03.319950 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8782bf9b-2679-437f-8143-e1b50a7b3bb2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:03.320394 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8782bf9b-2679-437f-8143-e1b50a7b3bb2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:03.384421 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-8782bf9b-2679-437f-8143-e1b50a7b3bb2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:03.393052 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-8782bf9b-2679-437f-8143-e1b50a7b3bb2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.085445 Jun 22 09:24:03.393617 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 697/1439] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:03 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:04.410089 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-03edd845-5041-4c8a-8b24-3319adfa141f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:04.410706 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-03edd845-5041-4c8a-8b24-3319adfa141f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:04.417421 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-03edd845-5041-4c8a-8b24-3319adfa141f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:04.417870 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-03edd845-5041-4c8a-8b24-3319adfa141f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:04.418626 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-03edd845-5041-4c8a-8b24-3319adfa141f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:04.419068 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-03edd845-5041-4c8a-8b24-3319adfa141f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:04.480241 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-03edd845-5041-4c8a-8b24-3319adfa141f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:04.488260 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-03edd845-5041-4c8a-8b24-3319adfa141f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082096 Jun 22 09:24:04.488839 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 743/1440] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:04 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:05.506781 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-cffaae5a-b14a-4259-9454-7209ae9df593 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:05.507315 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-cffaae5a-b14a-4259-9454-7209ae9df593 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:05.514405 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cffaae5a-b14a-4259-9454-7209ae9df593 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:05.514850 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cffaae5a-b14a-4259-9454-7209ae9df593 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:05.515607 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cffaae5a-b14a-4259-9454-7209ae9df593 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:05.516037 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cffaae5a-b14a-4259-9454-7209ae9df593 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:05.577409 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-cffaae5a-b14a-4259-9454-7209ae9df593 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:05.585209 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-cffaae5a-b14a-4259-9454-7209ae9df593 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082466 Jun 22 09:24:05.585759 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 698/1441] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:05 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:06.601363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e1e902ee-f890-4a2e-8989-0cf8310bd128 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:06.601977 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e1e902ee-f890-4a2e-8989-0cf8310bd128 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:06.608958 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e1e902ee-f890-4a2e-8989-0cf8310bd128 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:06.609402 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e1e902ee-f890-4a2e-8989-0cf8310bd128 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:06.610153 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e1e902ee-f890-4a2e-8989-0cf8310bd128 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:06.610586 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e1e902ee-f890-4a2e-8989-0cf8310bd128 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:06.674361 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-e1e902ee-f890-4a2e-8989-0cf8310bd128 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:06.682259 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e1e902ee-f890-4a2e-8989-0cf8310bd128 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084790 Jun 22 09:24:06.682821 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 744/1442] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:06 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:07.699603 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c4e015d3-b5c4-45b7-a3e9-2210f30d05c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:07.700215 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c4e015d3-b5c4-45b7-a3e9-2210f30d05c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:07.707690 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c4e015d3-b5c4-45b7-a3e9-2210f30d05c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:07.708144 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c4e015d3-b5c4-45b7-a3e9-2210f30d05c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:07.708934 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c4e015d3-b5c4-45b7-a3e9-2210f30d05c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:07.709374 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c4e015d3-b5c4-45b7-a3e9-2210f30d05c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:07.771868 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-c4e015d3-b5c4-45b7-a3e9-2210f30d05c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:07.780125 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c4e015d3-b5c4-45b7-a3e9-2210f30d05c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084403 Jun 22 09:24:07.780696 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 699/1443] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:07 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:08.797012 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-947d8dc0-7e85-4c33-9940-0bfa917b5549 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:08.797614 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-947d8dc0-7e85-4c33-9940-0bfa917b5549 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:08.804343 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-947d8dc0-7e85-4c33-9940-0bfa917b5549 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:08.804807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-947d8dc0-7e85-4c33-9940-0bfa917b5549 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:08.805567 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-947d8dc0-7e85-4c33-9940-0bfa917b5549 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:08.806000 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-947d8dc0-7e85-4c33-9940-0bfa917b5549 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:08.867124 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-947d8dc0-7e85-4c33-9940-0bfa917b5549 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:08.876213 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-947d8dc0-7e85-4c33-9940-0bfa917b5549 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083286 Jun 22 09:24:08.877644 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 745/1444] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:08 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:09.894229 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-faa109e3-1c8e-48e7-a9b1-06f284efb371 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:09.894841 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-faa109e3-1c8e-48e7-a9b1-06f284efb371 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:09.900844 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-faa109e3-1c8e-48e7-a9b1-06f284efb371 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:09.901296 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-faa109e3-1c8e-48e7-a9b1-06f284efb371 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:09.902051 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-faa109e3-1c8e-48e7-a9b1-06f284efb371 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:09.902484 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-faa109e3-1c8e-48e7-a9b1-06f284efb371 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:09.964273 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-faa109e3-1c8e-48e7-a9b1-06f284efb371 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:09.972888 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-faa109e3-1c8e-48e7-a9b1-06f284efb371 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082662 Jun 22 09:24:09.973457 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 700/1445] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:09 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:10.990559 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-45819005-4da0-4091-ab00-2ed41e92fe7b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:11.036133 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-45819005-4da0-4091-ab00-2ed41e92fe7b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:11.036133 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-45819005-4da0-4091-ab00-2ed41e92fe7b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:11.036133 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-45819005-4da0-4091-ab00-2ed41e92fe7b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:11.036133 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-45819005-4da0-4091-ab00-2ed41e92fe7b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:11.036611 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-45819005-4da0-4091-ab00-2ed41e92fe7b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:11.061292 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-45819005-4da0-4091-ab00-2ed41e92fe7b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:11.069475 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-45819005-4da0-4091-ab00-2ed41e92fe7b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083034 Jun 22 09:24:11.070051 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 746/1446] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:10 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:12.091453 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-832ff961-2bed-4e51-bc0b-c9713a6cb3c1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:12.092110 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-832ff961-2bed-4e51-bc0b-c9713a6cb3c1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:12.098815 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-832ff961-2bed-4e51-bc0b-c9713a6cb3c1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:12.099266 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-832ff961-2bed-4e51-bc0b-c9713a6cb3c1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:12.100304 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-832ff961-2bed-4e51-bc0b-c9713a6cb3c1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:12.100756 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-832ff961-2bed-4e51-bc0b-c9713a6cb3c1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:12.165786 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-832ff961-2bed-4e51-bc0b-c9713a6cb3c1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:12.174181 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-832ff961-2bed-4e51-bc0b-c9713a6cb3c1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.086645 Jun 22 09:24:12.174742 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 701/1447] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:12 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:13.191737 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-b2113977-2a19-4743-bb43-e17cf90431cf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:13.192357 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-b2113977-2a19-4743-bb43-e17cf90431cf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:13.198973 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b2113977-2a19-4743-bb43-e17cf90431cf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:13.199424 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b2113977-2a19-4743-bb43-e17cf90431cf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:13.200219 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b2113977-2a19-4743-bb43-e17cf90431cf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:13.200658 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b2113977-2a19-4743-bb43-e17cf90431cf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:13.261599 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-b2113977-2a19-4743-bb43-e17cf90431cf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:13.269808 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-b2113977-2a19-4743-bb43-e17cf90431cf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081923 Jun 22 09:24:13.270369 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 747/1448] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:13 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:14.286878 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a3fd3d28-1176-4959-bcc0-b665fba03ef3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:14.287490 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a3fd3d28-1176-4959-bcc0-b665fba03ef3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:14.294103 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a3fd3d28-1176-4959-bcc0-b665fba03ef3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:14.294546 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a3fd3d28-1176-4959-bcc0-b665fba03ef3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:14.295373 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a3fd3d28-1176-4959-bcc0-b665fba03ef3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:14.295936 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a3fd3d28-1176-4959-bcc0-b665fba03ef3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:14.357402 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-a3fd3d28-1176-4959-bcc0-b665fba03ef3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:14.365850 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a3fd3d28-1176-4959-bcc0-b665fba03ef3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082865 Jun 22 09:24:14.367560 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 702/1449] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:14 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:15.383444 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-cee24fcc-739d-4087-b704-eaaf6d8363ac tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:15.384054 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-cee24fcc-739d-4087-b704-eaaf6d8363ac tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:15.391421 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cee24fcc-739d-4087-b704-eaaf6d8363ac tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:15.391866 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cee24fcc-739d-4087-b704-eaaf6d8363ac tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:15.392684 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cee24fcc-739d-4087-b704-eaaf6d8363ac tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:15.393148 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cee24fcc-739d-4087-b704-eaaf6d8363ac tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:15.459512 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-cee24fcc-739d-4087-b704-eaaf6d8363ac tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:15.468129 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-cee24fcc-739d-4087-b704-eaaf6d8363ac tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.087922 Jun 22 09:24:15.468646 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 748/1450] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:15 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:16.485755 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-871f61b9-bcd6-4d82-bfc4-a18dd4a2b51b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:16.486748 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-871f61b9-bcd6-4d82-bfc4-a18dd4a2b51b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:16.493467 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-871f61b9-bcd6-4d82-bfc4-a18dd4a2b51b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:16.493916 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-871f61b9-bcd6-4d82-bfc4-a18dd4a2b51b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:16.494686 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-871f61b9-bcd6-4d82-bfc4-a18dd4a2b51b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:16.495128 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-871f61b9-bcd6-4d82-bfc4-a18dd4a2b51b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:16.556546 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-871f61b9-bcd6-4d82-bfc4-a18dd4a2b51b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:16.564681 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-871f61b9-bcd6-4d82-bfc4-a18dd4a2b51b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083566 Jun 22 09:24:16.565273 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 703/1451] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:16 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:17.581391 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-b6d60426-501e-43a8-af2a-b6e97e7f4a46 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:17.582003 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-b6d60426-501e-43a8-af2a-b6e97e7f4a46 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:17.588884 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b6d60426-501e-43a8-af2a-b6e97e7f4a46 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:17.589275 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b6d60426-501e-43a8-af2a-b6e97e7f4a46 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:17.590023 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b6d60426-501e-43a8-af2a-b6e97e7f4a46 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:17.590457 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b6d60426-501e-43a8-af2a-b6e97e7f4a46 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:17.650896 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-b6d60426-501e-43a8-af2a-b6e97e7f4a46 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:17.658657 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-b6d60426-501e-43a8-af2a-b6e97e7f4a46 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081088 Jun 22 09:24:17.659223 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 749/1452] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:17 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:18.675608 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-66c2e759-a523-4ff9-a68b-60a4b2a0c5c1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:18.676219 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-66c2e759-a523-4ff9-a68b-60a4b2a0c5c1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:18.682859 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-66c2e759-a523-4ff9-a68b-60a4b2a0c5c1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:18.683309 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-66c2e759-a523-4ff9-a68b-60a4b2a0c5c1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:18.684063 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-66c2e759-a523-4ff9-a68b-60a4b2a0c5c1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:18.684502 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-66c2e759-a523-4ff9-a68b-60a4b2a0c5c1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:18.747595 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-66c2e759-a523-4ff9-a68b-60a4b2a0c5c1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:18.755906 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-66c2e759-a523-4ff9-a68b-60a4b2a0c5c1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084150 Jun 22 09:24:18.756470 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 704/1453] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:18 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:19.773157 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-62af338c-3617-424b-bc53-f458fcb42b70 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:19.773773 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-62af338c-3617-424b-bc53-f458fcb42b70 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:19.780386 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-62af338c-3617-424b-bc53-f458fcb42b70 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:19.780864 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-62af338c-3617-424b-bc53-f458fcb42b70 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:19.781639 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-62af338c-3617-424b-bc53-f458fcb42b70 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:19.782063 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-62af338c-3617-424b-bc53-f458fcb42b70 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:19.845216 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-62af338c-3617-424b-bc53-f458fcb42b70 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:19.853235 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-62af338c-3617-424b-bc53-f458fcb42b70 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084065 Jun 22 09:24:19.853793 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 750/1454] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:19 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:20.870086 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-275ed40c-a5c2-4d4c-8b3d-a4c4d7e93aba tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:20.870692 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-275ed40c-a5c2-4d4c-8b3d-a4c4d7e93aba tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:20.877970 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-275ed40c-a5c2-4d4c-8b3d-a4c4d7e93aba tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:20.878412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-275ed40c-a5c2-4d4c-8b3d-a4c4d7e93aba tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:20.879168 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-275ed40c-a5c2-4d4c-8b3d-a4c4d7e93aba tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:20.879605 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-275ed40c-a5c2-4d4c-8b3d-a4c4d7e93aba tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:21.175118 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-275ed40c-a5c2-4d4c-8b3d-a4c4d7e93aba tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:21.183105 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-275ed40c-a5c2-4d4c-8b3d-a4c4d7e93aba tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.316914 Jun 22 09:24:21.183665 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 705/1455] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:20 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:22.204710 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-5035430e-9c61-49ab-8976-f1d266018023 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:22.205350 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-5035430e-9c61-49ab-8976-f1d266018023 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:22.212076 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5035430e-9c61-49ab-8976-f1d266018023 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:22.212523 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5035430e-9c61-49ab-8976-f1d266018023 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:22.213322 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5035430e-9c61-49ab-8976-f1d266018023 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:22.214151 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5035430e-9c61-49ab-8976-f1d266018023 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:22.274877 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-5035430e-9c61-49ab-8976-f1d266018023 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:22.283840 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-5035430e-9c61-49ab-8976-f1d266018023 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083422 Jun 22 09:24:22.284398 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 751/1456] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:22 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:23.301001 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ff69a7e6-0417-469e-b625-c6d372430104 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:23.301614 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ff69a7e6-0417-469e-b625-c6d372430104 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:23.308060 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ff69a7e6-0417-469e-b625-c6d372430104 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:23.308513 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ff69a7e6-0417-469e-b625-c6d372430104 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:23.309307 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ff69a7e6-0417-469e-b625-c6d372430104 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:23.309752 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ff69a7e6-0417-469e-b625-c6d372430104 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:23.369982 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ff69a7e6-0417-469e-b625-c6d372430104 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:23.378590 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ff69a7e6-0417-469e-b625-c6d372430104 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081547 Jun 22 09:24:23.379212 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 706/1457] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:23 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:24.395582 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-85cef8c2-17ab-417b-bf54-a11d0a7c3dd4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:24.396196 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-85cef8c2-17ab-417b-bf54-a11d0a7c3dd4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:24.402720 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-85cef8c2-17ab-417b-bf54-a11d0a7c3dd4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:24.403171 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-85cef8c2-17ab-417b-bf54-a11d0a7c3dd4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:24.403936 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-85cef8c2-17ab-417b-bf54-a11d0a7c3dd4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:24.404998 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-85cef8c2-17ab-417b-bf54-a11d0a7c3dd4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:24.463741 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-85cef8c2-17ab-417b-bf54-a11d0a7c3dd4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:24.472410 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-85cef8c2-17ab-417b-bf54-a11d0a7c3dd4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.080686 Jun 22 09:24:24.472937 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 752/1458] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:24 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:25.489653 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f9004bf2-01b0-4d95-8030-bc46e079db52 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:25.491608 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f9004bf2-01b0-4d95-8030-bc46e079db52 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:25.497023 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f9004bf2-01b0-4d95-8030-bc46e079db52 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:25.497474 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f9004bf2-01b0-4d95-8030-bc46e079db52 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:25.498351 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f9004bf2-01b0-4d95-8030-bc46e079db52 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:25.498880 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f9004bf2-01b0-4d95-8030-bc46e079db52 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:25.517243 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:24:25.561844 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-f9004bf2-01b0-4d95-8030-bc46e079db52 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:25.569718 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f9004bf2-01b0-4d95-8030-bc46e079db52 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083985 Jun 22 09:24:25.570280 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 707/1459] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:25 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:26.587091 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7e425873-b050-41fe-b543-5008e0a22dd8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:26.587706 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7e425873-b050-41fe-b543-5008e0a22dd8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:26.590233 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=31 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:24:26.596220 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7e425873-b050-41fe-b543-5008e0a22dd8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:26.596669 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7e425873-b050-41fe-b543-5008e0a22dd8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:26.597462 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7e425873-b050-41fe-b543-5008e0a22dd8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:26.597900 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7e425873-b050-41fe-b543-5008e0a22dd8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:26.601838 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=83 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:24:26.658149 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7e425873-b050-41fe-b543-5008e0a22dd8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:26.666282 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7e425873-b050-41fe-b543-5008e0a22dd8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083194 Jun 22 09:24:26.666841 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 753/1460] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:26 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:27.684098 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-52afc7d5-d8c2-4bb7-91b7-1a50d9d401d2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:27.684656 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-52afc7d5-d8c2-4bb7-91b7-1a50d9d401d2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:27.686952 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:24:27.691963 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-52afc7d5-d8c2-4bb7-91b7-1a50d9d401d2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:27.692414 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-52afc7d5-d8c2-4bb7-91b7-1a50d9d401d2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:27.693214 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-52afc7d5-d8c2-4bb7-91b7-1a50d9d401d2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:27.693654 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-52afc7d5-d8c2-4bb7-91b7-1a50d9d401d2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:27.754123 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-52afc7d5-d8c2-4bb7-91b7-1a50d9d401d2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:27.761994 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-52afc7d5-d8c2-4bb7-91b7-1a50d9d401d2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082202 Jun 22 09:24:27.762555 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 708/1461] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:27 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:28.778703 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-16c0b376-afa5-4b15-9599-a97ccd0cfa58 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:28.779363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-16c0b376-afa5-4b15-9599-a97ccd0cfa58 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:28.786449 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-16c0b376-afa5-4b15-9599-a97ccd0cfa58 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:28.786908 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-16c0b376-afa5-4b15-9599-a97ccd0cfa58 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:28.787669 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-16c0b376-afa5-4b15-9599-a97ccd0cfa58 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:28.788110 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-16c0b376-afa5-4b15-9599-a97ccd0cfa58 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:28.848231 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-16c0b376-afa5-4b15-9599-a97ccd0cfa58 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:28.856171 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-16c0b376-afa5-4b15-9599-a97ccd0cfa58 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081384 Jun 22 09:24:28.856734 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 754/1462] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:28 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:29.874385 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-7b38d210-e3a4-48c7-81eb-f02165cef72f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:29.874990 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-7b38d210-e3a4-48c7-81eb-f02165cef72f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:29.881792 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7b38d210-e3a4-48c7-81eb-f02165cef72f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:29.882241 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7b38d210-e3a4-48c7-81eb-f02165cef72f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:29.883007 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7b38d210-e3a4-48c7-81eb-f02165cef72f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:29.883446 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7b38d210-e3a4-48c7-81eb-f02165cef72f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:29.945336 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-7b38d210-e3a4-48c7-81eb-f02165cef72f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:29.954228 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-7b38d210-e3a4-48c7-81eb-f02165cef72f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084768 Jun 22 09:24:29.954785 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 709/1463] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:29 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:30.971695 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2336e544-ac9e-45cc-8e4a-7c3ffa62fde2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:30.972310 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2336e544-ac9e-45cc-8e4a-7c3ffa62fde2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:30.978752 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2336e544-ac9e-45cc-8e4a-7c3ffa62fde2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:30.979196 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2336e544-ac9e-45cc-8e4a-7c3ffa62fde2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:30.979945 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2336e544-ac9e-45cc-8e4a-7c3ffa62fde2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:30.980380 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2336e544-ac9e-45cc-8e4a-7c3ffa62fde2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:31.042123 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-2336e544-ac9e-45cc-8e4a-7c3ffa62fde2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:31.050508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2336e544-ac9e-45cc-8e4a-7c3ffa62fde2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082730 Jun 22 09:24:31.051066 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 755/1464] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:30 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:32.067492 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-d88f7f8a-aa1a-4417-a87c-e3f4216a30a1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:32.068051 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-d88f7f8a-aa1a-4417-a87c-e3f4216a30a1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:32.074613 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d88f7f8a-aa1a-4417-a87c-e3f4216a30a1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:32.075070 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d88f7f8a-aa1a-4417-a87c-e3f4216a30a1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:32.076375 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d88f7f8a-aa1a-4417-a87c-e3f4216a30a1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:32.076859 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d88f7f8a-aa1a-4417-a87c-e3f4216a30a1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:32.137413 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-d88f7f8a-aa1a-4417-a87c-e3f4216a30a1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:32.145573 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-d88f7f8a-aa1a-4417-a87c-e3f4216a30a1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082069 Jun 22 09:24:32.146135 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 710/1465] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:32 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:33.162965 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-906ddae7-4d92-4dd7-b8e5-a37efb8531c0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:33.163596 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-906ddae7-4d92-4dd7-b8e5-a37efb8531c0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:33.170235 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-906ddae7-4d92-4dd7-b8e5-a37efb8531c0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:33.170677 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-906ddae7-4d92-4dd7-b8e5-a37efb8531c0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:33.171427 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-906ddae7-4d92-4dd7-b8e5-a37efb8531c0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:33.171862 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-906ddae7-4d92-4dd7-b8e5-a37efb8531c0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:33.233107 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-906ddae7-4d92-4dd7-b8e5-a37efb8531c0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:33.241529 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-906ddae7-4d92-4dd7-b8e5-a37efb8531c0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082405 Jun 22 09:24:33.242097 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 756/1466] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:33 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:34.259324 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-92dad1dd-21e2-4922-9891-2ef722e70d7a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:34.259939 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-92dad1dd-21e2-4922-9891-2ef722e70d7a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:34.267358 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-92dad1dd-21e2-4922-9891-2ef722e70d7a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:34.267809 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-92dad1dd-21e2-4922-9891-2ef722e70d7a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:34.268572 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-92dad1dd-21e2-4922-9891-2ef722e70d7a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:34.269053 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-92dad1dd-21e2-4922-9891-2ef722e70d7a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:34.333809 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-92dad1dd-21e2-4922-9891-2ef722e70d7a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:34.342688 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-92dad1dd-21e2-4922-9891-2ef722e70d7a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.087363 Jun 22 09:24:34.343247 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 711/1467] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:34 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:35.360337 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-bbb2fb23-3681-43b6-b102-edc36c99b370 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:35.361679 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-bbb2fb23-3681-43b6-b102-edc36c99b370 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:35.368732 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bbb2fb23-3681-43b6-b102-edc36c99b370 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:35.369220 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bbb2fb23-3681-43b6-b102-edc36c99b370 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:35.370038 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bbb2fb23-3681-43b6-b102-edc36c99b370 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:35.370510 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bbb2fb23-3681-43b6-b102-edc36c99b370 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:35.432246 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-bbb2fb23-3681-43b6-b102-edc36c99b370 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:35.440391 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-bbb2fb23-3681-43b6-b102-edc36c99b370 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.085002 Jun 22 09:24:35.440981 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 757/1468] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:35 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:36.467671 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1788cd3f-b312-4edb-ba32-9190b39694db tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:36.468234 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1788cd3f-b312-4edb-ba32-9190b39694db tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:36.474708 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1788cd3f-b312-4edb-ba32-9190b39694db tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:36.475141 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1788cd3f-b312-4edb-ba32-9190b39694db tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:36.475906 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1788cd3f-b312-4edb-ba32-9190b39694db tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:36.476348 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1788cd3f-b312-4edb-ba32-9190b39694db tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:36.539592 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-1788cd3f-b312-4edb-ba32-9190b39694db tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:36.548571 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1788cd3f-b312-4edb-ba32-9190b39694db tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084826 Jun 22 09:24:36.549365 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 712/1469] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:36 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:37.566283 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-8f7b50b3-9176-496d-a1b8-8a28b26dcd7b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:37.566913 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-8f7b50b3-9176-496d-a1b8-8a28b26dcd7b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:37.573457 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8f7b50b3-9176-496d-a1b8-8a28b26dcd7b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:37.573899 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8f7b50b3-9176-496d-a1b8-8a28b26dcd7b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:37.574659 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8f7b50b3-9176-496d-a1b8-8a28b26dcd7b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:37.575120 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8f7b50b3-9176-496d-a1b8-8a28b26dcd7b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:37.635480 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-8f7b50b3-9176-496d-a1b8-8a28b26dcd7b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:37.644166 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-8f7b50b3-9176-496d-a1b8-8a28b26dcd7b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081791 Jun 22 09:24:37.644740 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 758/1470] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:37 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:38.661459 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-078900e3-cb09-4910-86e9-7e71115e1ffa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:38.662078 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-078900e3-cb09-4910-86e9-7e71115e1ffa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:38.668526 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-078900e3-cb09-4910-86e9-7e71115e1ffa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:38.669001 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-078900e3-cb09-4910-86e9-7e71115e1ffa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:38.669959 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-078900e3-cb09-4910-86e9-7e71115e1ffa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:38.670394 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-078900e3-cb09-4910-86e9-7e71115e1ffa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:38.733709 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-078900e3-cb09-4910-86e9-7e71115e1ffa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:38.741634 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-078900e3-cb09-4910-86e9-7e71115e1ffa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084084 Jun 22 09:24:38.742195 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 713/1471] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:38 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:39.759008 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-479563df-14e3-4632-87eb-920cf9f9e17d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:39.759651 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-479563df-14e3-4632-87eb-920cf9f9e17d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:39.766504 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-479563df-14e3-4632-87eb-920cf9f9e17d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:39.766955 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-479563df-14e3-4632-87eb-920cf9f9e17d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:39.767716 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-479563df-14e3-4632-87eb-920cf9f9e17d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:39.768164 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-479563df-14e3-4632-87eb-920cf9f9e17d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:39.828914 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-479563df-14e3-4632-87eb-920cf9f9e17d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:39.836802 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-479563df-14e3-4632-87eb-920cf9f9e17d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081649 Jun 22 09:24:39.837382 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 759/1472] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:39 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:24:40.853914 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-421b5c9c-93a2-476f-8adb-806519670525 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:40.854470 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-421b5c9c-93a2-476f-8adb-806519670525 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:40.865074 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-421b5c9c-93a2-476f-8adb-806519670525 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:40.865736 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-421b5c9c-93a2-476f-8adb-806519670525 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:40.866525 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-421b5c9c-93a2-476f-8adb-806519670525 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:40.866966 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-421b5c9c-93a2-476f-8adb-806519670525 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:40.930105 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-421b5c9c-93a2-476f-8adb-806519670525 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:40.938690 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-421b5c9c-93a2-476f-8adb-806519670525 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.088798 Jun 22 09:24:40.939278 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 714/1473] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:40 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:41.955920 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-3312ee32-0f5b-4351-b5bb-0125d8ab232e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:41.956517 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-3312ee32-0f5b-4351-b5bb-0125d8ab232e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:41.962513 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3312ee32-0f5b-4351-b5bb-0125d8ab232e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:41.962956 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3312ee32-0f5b-4351-b5bb-0125d8ab232e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:41.963712 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3312ee32-0f5b-4351-b5bb-0125d8ab232e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:41.964146 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3312ee32-0f5b-4351-b5bb-0125d8ab232e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:42.024599 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-3312ee32-0f5b-4351-b5bb-0125d8ab232e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:42.032992 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-3312ee32-0f5b-4351-b5bb-0125d8ab232e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081052 Jun 22 09:24:42.033551 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 760/1474] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:41 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:43.050605 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-5326e7fc-0b88-4742-bec2-e1f60bae0d1f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:43.051201 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-5326e7fc-0b88-4742-bec2-e1f60bae0d1f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:43.057751 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5326e7fc-0b88-4742-bec2-e1f60bae0d1f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:43.058229 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5326e7fc-0b88-4742-bec2-e1f60bae0d1f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:43.058995 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5326e7fc-0b88-4742-bec2-e1f60bae0d1f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:43.059438 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5326e7fc-0b88-4742-bec2-e1f60bae0d1f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:43.121384 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-5326e7fc-0b88-4742-bec2-e1f60bae0d1f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:43.130210 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-5326e7fc-0b88-4742-bec2-e1f60bae0d1f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083549 Jun 22 09:24:43.130775 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 715/1475] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:43 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:24:44.147179 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-3dd119e2-ea15-45c5-a116-433f27adff1d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:44.147758 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-3dd119e2-ea15-45c5-a116-433f27adff1d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:44.154872 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3dd119e2-ea15-45c5-a116-433f27adff1d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:44.155327 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3dd119e2-ea15-45c5-a116-433f27adff1d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:44.156087 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3dd119e2-ea15-45c5-a116-433f27adff1d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:44.156526 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3dd119e2-ea15-45c5-a116-433f27adff1d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:44.217274 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-3dd119e2-ea15-45c5-a116-433f27adff1d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:44.225258 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-3dd119e2-ea15-45c5-a116-433f27adff1d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081997 Jun 22 09:24:44.225827 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 761/1476] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:44 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:45.243026 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-340af473-9057-4ab9-b454-462786d224fd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:45.243839 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-340af473-9057-4ab9-b454-462786d224fd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:45.251594 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-340af473-9057-4ab9-b454-462786d224fd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:45.252043 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-340af473-9057-4ab9-b454-462786d224fd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:45.252835 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-340af473-9057-4ab9-b454-462786d224fd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:45.253277 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-340af473-9057-4ab9-b454-462786d224fd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:45.313893 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-340af473-9057-4ab9-b454-462786d224fd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:45.321875 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-340af473-9057-4ab9-b454-462786d224fd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082738 Jun 22 09:24:45.322476 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 716/1477] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:45 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:24:46.339351 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-3b91b84a-9d9e-480a-b694-67e31cda5ed6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:46.339967 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-3b91b84a-9d9e-480a-b694-67e31cda5ed6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:46.346716 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3b91b84a-9d9e-480a-b694-67e31cda5ed6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:46.347170 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3b91b84a-9d9e-480a-b694-67e31cda5ed6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:46.347932 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3b91b84a-9d9e-480a-b694-67e31cda5ed6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:46.348398 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3b91b84a-9d9e-480a-b694-67e31cda5ed6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:46.410385 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-3b91b84a-9d9e-480a-b694-67e31cda5ed6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:46.418424 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-3b91b84a-9d9e-480a-b694-67e31cda5ed6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082973 Jun 22 09:24:46.418990 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 762/1478] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:46 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:47.435555 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-fa17748d-eee2-4df8-84fd-44bd41ac75a5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:47.439431 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-fa17748d-eee2-4df8-84fd-44bd41ac75a5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:47.442962 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fa17748d-eee2-4df8-84fd-44bd41ac75a5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:47.443427 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fa17748d-eee2-4df8-84fd-44bd41ac75a5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:47.444203 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fa17748d-eee2-4df8-84fd-44bd41ac75a5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:47.444648 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fa17748d-eee2-4df8-84fd-44bd41ac75a5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:47.510656 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-fa17748d-eee2-4df8-84fd-44bd41ac75a5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:47.519852 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-fa17748d-eee2-4df8-84fd-44bd41ac75a5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.088339 Jun 22 09:24:47.520418 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 717/1479] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:47 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:48.537726 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-51fa691f-22b6-4fb8-a2ef-da7338596722 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:48.538347 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-51fa691f-22b6-4fb8-a2ef-da7338596722 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:48.545158 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-51fa691f-22b6-4fb8-a2ef-da7338596722 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:48.545611 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-51fa691f-22b6-4fb8-a2ef-da7338596722 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:48.546376 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-51fa691f-22b6-4fb8-a2ef-da7338596722 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:48.546816 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-51fa691f-22b6-4fb8-a2ef-da7338596722 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:48.606814 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-51fa691f-22b6-4fb8-a2ef-da7338596722 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:48.614890 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-51fa691f-22b6-4fb8-a2ef-da7338596722 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081082 Jun 22 09:24:48.615453 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 763/1480] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:48 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:49.631945 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-bd6ad2f2-24f4-4a70-96c9-ded1bf6702f3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:49.632479 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-bd6ad2f2-24f4-4a70-96c9-ded1bf6702f3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:49.639548 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bd6ad2f2-24f4-4a70-96c9-ded1bf6702f3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:49.640034 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bd6ad2f2-24f4-4a70-96c9-ded1bf6702f3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:49.640813 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bd6ad2f2-24f4-4a70-96c9-ded1bf6702f3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:49.641255 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bd6ad2f2-24f4-4a70-96c9-ded1bf6702f3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:49.701513 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-bd6ad2f2-24f4-4a70-96c9-ded1bf6702f3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:49.709557 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-bd6ad2f2-24f4-4a70-96c9-ded1bf6702f3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081525 Jun 22 09:24:49.710117 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 718/1481] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:49 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:50.726431 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-5d8cd569-9235-41cc-9c50-6334710240a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:50.727064 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-5d8cd569-9235-41cc-9c50-6334710240a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:50.734290 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5d8cd569-9235-41cc-9c50-6334710240a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:50.734737 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5d8cd569-9235-41cc-9c50-6334710240a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:50.735497 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5d8cd569-9235-41cc-9c50-6334710240a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:50.735935 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5d8cd569-9235-41cc-9c50-6334710240a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:50.796713 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-5d8cd569-9235-41cc-9c50-6334710240a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:50.804687 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-5d8cd569-9235-41cc-9c50-6334710240a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082210 Jun 22 09:24:50.805275 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 764/1482] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:50 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:51.822197 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1b75dd39-40b2-4f28-ad6b-2513eb50942a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:51.822817 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1b75dd39-40b2-4f28-ad6b-2513eb50942a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:51.829954 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1b75dd39-40b2-4f28-ad6b-2513eb50942a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:51.830392 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1b75dd39-40b2-4f28-ad6b-2513eb50942a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:51.831141 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1b75dd39-40b2-4f28-ad6b-2513eb50942a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:51.831572 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1b75dd39-40b2-4f28-ad6b-2513eb50942a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:51.894984 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-1b75dd39-40b2-4f28-ad6b-2513eb50942a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:51.902960 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1b75dd39-40b2-4f28-ad6b-2513eb50942a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084676 Jun 22 09:24:51.903546 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 719/1483] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:51 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:52.919655 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9f41e53b-c0f7-4dba-9f8f-62d3871b96e7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:52.920273 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9f41e53b-c0f7-4dba-9f8f-62d3871b96e7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:52.926740 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9f41e53b-c0f7-4dba-9f8f-62d3871b96e7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:52.927187 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9f41e53b-c0f7-4dba-9f8f-62d3871b96e7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:52.927950 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9f41e53b-c0f7-4dba-9f8f-62d3871b96e7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:52.928377 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9f41e53b-c0f7-4dba-9f8f-62d3871b96e7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:52.988131 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9f41e53b-c0f7-4dba-9f8f-62d3871b96e7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:52.995935 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9f41e53b-c0f7-4dba-9f8f-62d3871b96e7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.080419 Jun 22 09:24:52.996488 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 765/1484] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:52 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:54.013518 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-7f58ab1b-7139-41b4-bacf-61f7ca7066f3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:54.014109 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-7f58ab1b-7139-41b4-bacf-61f7ca7066f3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:54.020520 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7f58ab1b-7139-41b4-bacf-61f7ca7066f3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:54.021001 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7f58ab1b-7139-41b4-bacf-61f7ca7066f3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:54.021756 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7f58ab1b-7139-41b4-bacf-61f7ca7066f3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:54.022189 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7f58ab1b-7139-41b4-bacf-61f7ca7066f3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:54.082452 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-7f58ab1b-7139-41b4-bacf-61f7ca7066f3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:54.090279 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-7f58ab1b-7139-41b4-bacf-61f7ca7066f3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.080683 Jun 22 09:24:54.091344 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 720/1485] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:54 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:55.107676 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-bed9fd69-9839-4e45-ac1b-7538978cce8b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:55.108336 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-bed9fd69-9839-4e45-ac1b-7538978cce8b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:55.114826 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bed9fd69-9839-4e45-ac1b-7538978cce8b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:55.115272 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bed9fd69-9839-4e45-ac1b-7538978cce8b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:55.116023 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bed9fd69-9839-4e45-ac1b-7538978cce8b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:55.116465 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bed9fd69-9839-4e45-ac1b-7538978cce8b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:55.176752 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-bed9fd69-9839-4e45-ac1b-7538978cce8b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:55.184686 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-bed9fd69-9839-4e45-ac1b-7538978cce8b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081016 Jun 22 09:24:55.185381 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 766/1486] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:55 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:56.201984 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6e1b494a-c4ed-4ee0-852f-0a0591ba83d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:56.202593 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-6e1b494a-c4ed-4ee0-852f-0a0591ba83d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:56.209096 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6e1b494a-c4ed-4ee0-852f-0a0591ba83d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:56.209550 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6e1b494a-c4ed-4ee0-852f-0a0591ba83d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:56.210308 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6e1b494a-c4ed-4ee0-852f-0a0591ba83d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:56.210746 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6e1b494a-c4ed-4ee0-852f-0a0591ba83d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:56.273398 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-6e1b494a-c4ed-4ee0-852f-0a0591ba83d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:56.281701 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-6e1b494a-c4ed-4ee0-852f-0a0591ba83d0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083762 Jun 22 09:24:56.282256 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 721/1487] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:56 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:57.299090 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-0f792618-a04d-4a58-9749-e177b5d2a1e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:57.299697 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-0f792618-a04d-4a58-9749-e177b5d2a1e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:57.302038 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=28 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:24:57.306745 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0f792618-a04d-4a58-9749-e177b5d2a1e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:57.307186 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0f792618-a04d-4a58-9749-e177b5d2a1e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:57.307946 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0f792618-a04d-4a58-9749-e177b5d2a1e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:57.308382 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0f792618-a04d-4a58-9749-e177b5d2a1e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:57.368744 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-0f792618-a04d-4a58-9749-e177b5d2a1e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:57.377810 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-0f792618-a04d-4a58-9749-e177b5d2a1e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082491 Jun 22 09:24:57.378366 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 767/1488] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:57 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:58.395721 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c9e63a60-faf6-489f-9f7f-cb2b5488b19d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:58.396340 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c9e63a60-faf6-489f-9f7f-cb2b5488b19d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:58.403489 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c9e63a60-faf6-489f-9f7f-cb2b5488b19d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:58.403953 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c9e63a60-faf6-489f-9f7f-cb2b5488b19d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:58.404717 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c9e63a60-faf6-489f-9f7f-cb2b5488b19d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:58.405187 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c9e63a60-faf6-489f-9f7f-cb2b5488b19d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:58.409072 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=87 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:24:58.465768 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-c9e63a60-faf6-489f-9f7f-cb2b5488b19d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:58.473692 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c9e63a60-faf6-489f-9f7f-cb2b5488b19d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082150 Jun 22 09:24:58.474250 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 722/1489] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:58 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:59.202109 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:24:59.202665 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Wed Jun 22 09:24:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:24:59.490871 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-199e3e49-baee-4fc0-9b17-f5038171eb5f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:59.491515 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-199e3e49-baee-4fc0-9b17-f5038171eb5f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:59.498724 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-199e3e49-baee-4fc0-9b17-f5038171eb5f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:59.500116 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-199e3e49-baee-4fc0-9b17-f5038171eb5f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:59.500245 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-199e3e49-baee-4fc0-9b17-f5038171eb5f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:59.500704 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-199e3e49-baee-4fc0-9b17-f5038171eb5f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:59.503234 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=90 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:24:59.564463 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-199e3e49-baee-4fc0-9b17-f5038171eb5f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:59.572502 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-199e3e49-baee-4fc0-9b17-f5038171eb5f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.085514 Jun 22 09:24:59.573082 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 768/1490] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:59 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:00.589517 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-aace4f7e-9d24-4397-8ba9-cdff2881b4a2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:00.590150 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-aace4f7e-9d24-4397-8ba9-cdff2881b4a2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:00.593485 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=30 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:25:00.598209 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-aace4f7e-9d24-4397-8ba9-cdff2881b4a2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:00.598669 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-aace4f7e-9d24-4397-8ba9-cdff2881b4a2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:00.599537 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-aace4f7e-9d24-4397-8ba9-cdff2881b4a2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:00.599979 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-aace4f7e-9d24-4397-8ba9-cdff2881b4a2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:00.669011 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-aace4f7e-9d24-4397-8ba9-cdff2881b4a2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:00.678236 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-aace4f7e-9d24-4397-8ba9-cdff2881b4a2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.092604 Jun 22 09:25:00.678790 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 723/1491] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:00 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:01.695682 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-58fdfd22-f901-4889-9a90-e700c54a003a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:01.696304 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-58fdfd22-f901-4889-9a90-e700c54a003a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:01.703032 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-58fdfd22-f901-4889-9a90-e700c54a003a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:01.703484 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-58fdfd22-f901-4889-9a90-e700c54a003a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:01.704247 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-58fdfd22-f901-4889-9a90-e700c54a003a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:01.704683 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-58fdfd22-f901-4889-9a90-e700c54a003a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:01.765915 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-58fdfd22-f901-4889-9a90-e700c54a003a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:01.773854 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-58fdfd22-f901-4889-9a90-e700c54a003a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082049 Jun 22 09:25:01.774414 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 769/1492] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:01 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:02.790436 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-9a0136f3-01e8-487f-bd2b-5d60b9542d43 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:02.791128 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-9a0136f3-01e8-487f-bd2b-5d60b9542d43 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:02.798403 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9a0136f3-01e8-487f-bd2b-5d60b9542d43 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:02.798930 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9a0136f3-01e8-487f-bd2b-5d60b9542d43 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:02.799770 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9a0136f3-01e8-487f-bd2b-5d60b9542d43 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:02.800211 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9a0136f3-01e8-487f-bd2b-5d60b9542d43 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:02.864342 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-9a0136f3-01e8-487f-bd2b-5d60b9542d43 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:02.872263 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-9a0136f3-01e8-487f-bd2b-5d60b9542d43 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.086262 Jun 22 09:25:02.873518 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 724/1493] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:02 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:03.890846 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-bc5dc8c4-78bc-4bbc-863e-e802ac94a15a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:03.891455 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-bc5dc8c4-78bc-4bbc-863e-e802ac94a15a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:03.897908 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bc5dc8c4-78bc-4bbc-863e-e802ac94a15a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:03.898353 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bc5dc8c4-78bc-4bbc-863e-e802ac94a15a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:03.899102 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bc5dc8c4-78bc-4bbc-863e-e802ac94a15a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:03.899538 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bc5dc8c4-78bc-4bbc-863e-e802ac94a15a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:04.093786 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-bc5dc8c4-78bc-4bbc-863e-e802ac94a15a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:04.101666 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-bc5dc8c4-78bc-4bbc-863e-e802ac94a15a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.215463 Jun 22 09:25:04.102221 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 770/1494] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:03 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:05.119736 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-300fa1bb-9122-4cea-b50c-40d49e77446b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:05.120353 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-300fa1bb-9122-4cea-b50c-40d49e77446b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:05.127623 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-300fa1bb-9122-4cea-b50c-40d49e77446b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:05.128063 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-300fa1bb-9122-4cea-b50c-40d49e77446b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:05.128836 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-300fa1bb-9122-4cea-b50c-40d49e77446b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:05.129269 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-300fa1bb-9122-4cea-b50c-40d49e77446b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:05.191914 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-300fa1bb-9122-4cea-b50c-40d49e77446b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:05.199966 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-300fa1bb-9122-4cea-b50c-40d49e77446b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084273 Jun 22 09:25:05.200519 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 725/1495] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:05 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:06.217552 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-62b89bb3-f299-4559-8c7f-6f2b8a2019b0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:06.218166 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-62b89bb3-f299-4559-8c7f-6f2b8a2019b0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:06.224594 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-62b89bb3-f299-4559-8c7f-6f2b8a2019b0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:06.225073 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-62b89bb3-f299-4559-8c7f-6f2b8a2019b0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:06.225833 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-62b89bb3-f299-4559-8c7f-6f2b8a2019b0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:06.226270 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-62b89bb3-f299-4559-8c7f-6f2b8a2019b0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:06.286212 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-62b89bb3-f299-4559-8c7f-6f2b8a2019b0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:06.294018 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-62b89bb3-f299-4559-8c7f-6f2b8a2019b0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.080403 Jun 22 09:25:06.294579 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 771/1496] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:06 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:07.312205 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-241d0a9e-10b2-4645-bdd4-9d5775adff0a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:07.312838 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-241d0a9e-10b2-4645-bdd4-9d5775adff0a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:07.319359 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-241d0a9e-10b2-4645-bdd4-9d5775adff0a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:07.319808 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-241d0a9e-10b2-4645-bdd4-9d5775adff0a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:07.320566 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-241d0a9e-10b2-4645-bdd4-9d5775adff0a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:07.321029 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-241d0a9e-10b2-4645-bdd4-9d5775adff0a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:07.383011 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-241d0a9e-10b2-4645-bdd4-9d5775adff0a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:07.392044 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-241d0a9e-10b2-4645-bdd4-9d5775adff0a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084481 Jun 22 09:25:07.392611 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 726/1497] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:07 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:08.409600 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d780c93d-71b4-48b8-8300-d7e629fdf6d5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:08.410205 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-d780c93d-71b4-48b8-8300-d7e629fdf6d5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:08.416720 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d780c93d-71b4-48b8-8300-d7e629fdf6d5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:08.417205 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d780c93d-71b4-48b8-8300-d7e629fdf6d5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:08.417968 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d780c93d-71b4-48b8-8300-d7e629fdf6d5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:08.418411 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d780c93d-71b4-48b8-8300-d7e629fdf6d5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:08.481560 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-d780c93d-71b4-48b8-8300-d7e629fdf6d5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:08.489612 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d780c93d-71b4-48b8-8300-d7e629fdf6d5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084771 Jun 22 09:25:08.490170 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 772/1498] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:08 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:09.508050 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ee2d2ecf-6a01-437e-a7f9-ed9ff08573d7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:09.508605 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ee2d2ecf-6a01-437e-a7f9-ed9ff08573d7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:09.515312 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ee2d2ecf-6a01-437e-a7f9-ed9ff08573d7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:09.515766 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ee2d2ecf-6a01-437e-a7f9-ed9ff08573d7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:09.516551 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ee2d2ecf-6a01-437e-a7f9-ed9ff08573d7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:09.517035 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ee2d2ecf-6a01-437e-a7f9-ed9ff08573d7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:09.580647 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ee2d2ecf-6a01-437e-a7f9-ed9ff08573d7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:09.588614 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ee2d2ecf-6a01-437e-a7f9-ed9ff08573d7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084949 Jun 22 09:25:09.589417 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 727/1499] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:09 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:10.606405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2cc40e32-e0d1-46c6-bd29-7df2020a1f9c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:10.607032 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2cc40e32-e0d1-46c6-bd29-7df2020a1f9c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:10.613896 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2cc40e32-e0d1-46c6-bd29-7df2020a1f9c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:10.614348 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2cc40e32-e0d1-46c6-bd29-7df2020a1f9c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:10.615114 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2cc40e32-e0d1-46c6-bd29-7df2020a1f9c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:10.615560 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2cc40e32-e0d1-46c6-bd29-7df2020a1f9c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:10.677588 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-2cc40e32-e0d1-46c6-bd29-7df2020a1f9c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:10.686815 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2cc40e32-e0d1-46c6-bd29-7df2020a1f9c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083322 Jun 22 09:25:10.687389 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 773/1500] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:10 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:11.705404 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-70aaa8c9-d5df-4ed8-aafd-3bd155a2e656 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:11.706016 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-70aaa8c9-d5df-4ed8-aafd-3bd155a2e656 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:11.711971 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-70aaa8c9-d5df-4ed8-aafd-3bd155a2e656 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:11.712412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-70aaa8c9-d5df-4ed8-aafd-3bd155a2e656 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:11.713196 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-70aaa8c9-d5df-4ed8-aafd-3bd155a2e656 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:11.713632 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-70aaa8c9-d5df-4ed8-aafd-3bd155a2e656 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:11.777495 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-70aaa8c9-d5df-4ed8-aafd-3bd155a2e656 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:11.786094 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-70aaa8c9-d5df-4ed8-aafd-3bd155a2e656 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.085421 Jun 22 09:25:11.786739 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 728/1501] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:11 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:12.813199 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-6a705d1a-fbc8-4ebe-a488-cdc144ebbd87 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:12.813845 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-6a705d1a-fbc8-4ebe-a488-cdc144ebbd87 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:12.820010 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6a705d1a-fbc8-4ebe-a488-cdc144ebbd87 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:12.820460 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6a705d1a-fbc8-4ebe-a488-cdc144ebbd87 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:12.821246 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6a705d1a-fbc8-4ebe-a488-cdc144ebbd87 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:12.821687 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6a705d1a-fbc8-4ebe-a488-cdc144ebbd87 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:12.883894 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-6a705d1a-fbc8-4ebe-a488-cdc144ebbd87 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:12.892688 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-6a705d1a-fbc8-4ebe-a488-cdc144ebbd87 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083869 Jun 22 09:25:12.893289 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 774/1502] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:12 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:13.909235 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-2840a7b1-c5b8-4eda-a05e-d0726732718f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:13.909823 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-2840a7b1-c5b8-4eda-a05e-d0726732718f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:13.916361 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2840a7b1-c5b8-4eda-a05e-d0726732718f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:13.916853 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2840a7b1-c5b8-4eda-a05e-d0726732718f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:13.917609 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2840a7b1-c5b8-4eda-a05e-d0726732718f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:13.918040 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2840a7b1-c5b8-4eda-a05e-d0726732718f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:13.980537 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-2840a7b1-c5b8-4eda-a05e-d0726732718f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:13.989301 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-2840a7b1-c5b8-4eda-a05e-d0726732718f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083848 Jun 22 09:25:13.989871 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 729/1503] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:13 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:15.006619 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-129fda29-1c9c-4776-911c-8b3274865d13 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:15.007217 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-129fda29-1c9c-4776-911c-8b3274865d13 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:15.014427 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-129fda29-1c9c-4776-911c-8b3274865d13 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:15.014866 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-129fda29-1c9c-4776-911c-8b3274865d13 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:15.015619 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-129fda29-1c9c-4776-911c-8b3274865d13 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:15.016055 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-129fda29-1c9c-4776-911c-8b3274865d13 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:15.078031 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-129fda29-1c9c-4776-911c-8b3274865d13 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:15.086292 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-129fda29-1c9c-4776-911c-8b3274865d13 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083604 Jun 22 09:25:15.086847 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 775/1504] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:15 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:16.104110 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-46855164-c172-4563-8f6e-766439e7d1ae tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:16.104725 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-46855164-c172-4563-8f6e-766439e7d1ae tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:16.111648 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-46855164-c172-4563-8f6e-766439e7d1ae tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:16.112101 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-46855164-c172-4563-8f6e-766439e7d1ae tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:16.112886 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-46855164-c172-4563-8f6e-766439e7d1ae tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:16.113327 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-46855164-c172-4563-8f6e-766439e7d1ae tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:16.174730 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-46855164-c172-4563-8f6e-766439e7d1ae tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:16.183063 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-46855164-c172-4563-8f6e-766439e7d1ae tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082965 Jun 22 09:25:16.183625 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 730/1505] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:16 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:17.199831 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-1680e63b-b580-4877-a708-7db0b71a1eb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:17.200440 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-1680e63b-b580-4877-a708-7db0b71a1eb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:17.207240 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1680e63b-b580-4877-a708-7db0b71a1eb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:17.207686 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1680e63b-b580-4877-a708-7db0b71a1eb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:17.208442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1680e63b-b580-4877-a708-7db0b71a1eb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:17.208911 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1680e63b-b580-4877-a708-7db0b71a1eb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:17.271531 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-1680e63b-b580-4877-a708-7db0b71a1eb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:17.279911 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-1680e63b-b580-4877-a708-7db0b71a1eb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083896 Jun 22 09:25:17.280455 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 776/1506] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:17 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:18.297731 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3977d2a3-ccfc-4650-9d4c-b74910249af0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:18.298350 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3977d2a3-ccfc-4650-9d4c-b74910249af0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:18.305216 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3977d2a3-ccfc-4650-9d4c-b74910249af0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:18.305667 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3977d2a3-ccfc-4650-9d4c-b74910249af0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:18.306458 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3977d2a3-ccfc-4650-9d4c-b74910249af0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:18.306902 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3977d2a3-ccfc-4650-9d4c-b74910249af0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:18.375138 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3977d2a3-ccfc-4650-9d4c-b74910249af0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:18.383706 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3977d2a3-ccfc-4650-9d4c-b74910249af0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.090454 Jun 22 09:25:18.384158 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 731/1507] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:18 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:19.401007 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-329c0bdb-5741-4792-bd61-1c8699e1e822 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:19.401623 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-329c0bdb-5741-4792-bd61-1c8699e1e822 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:19.408212 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-329c0bdb-5741-4792-bd61-1c8699e1e822 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:19.408656 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-329c0bdb-5741-4792-bd61-1c8699e1e822 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:19.409443 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-329c0bdb-5741-4792-bd61-1c8699e1e822 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:19.409895 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-329c0bdb-5741-4792-bd61-1c8699e1e822 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:19.470047 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-329c0bdb-5741-4792-bd61-1c8699e1e822 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:19.478837 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-329c0bdb-5741-4792-bd61-1c8699e1e822 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081759 Jun 22 09:25:19.479397 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 777/1508] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:19 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:20.495339 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3acd3211-0a67-41c8-8703-5d0de60d6bbc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:20.495901 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3acd3211-0a67-41c8-8703-5d0de60d6bbc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:20.503219 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3acd3211-0a67-41c8-8703-5d0de60d6bbc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:20.503662 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3acd3211-0a67-41c8-8703-5d0de60d6bbc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:20.504415 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3acd3211-0a67-41c8-8703-5d0de60d6bbc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:20.504877 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3acd3211-0a67-41c8-8703-5d0de60d6bbc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:20.573479 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3acd3211-0a67-41c8-8703-5d0de60d6bbc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:20.574072 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3acd3211-0a67-41c8-8703-5d0de60d6bbc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082773 Jun 22 09:25:20.574630 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 732/1509] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:20 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:21.590362 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-0157faaf-27fc-4710-aa37-e946b97610ec tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:21.591555 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-0157faaf-27fc-4710-aa37-e946b97610ec tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:21.598084 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0157faaf-27fc-4710-aa37-e946b97610ec tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:21.598529 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0157faaf-27fc-4710-aa37-e946b97610ec tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:21.599284 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0157faaf-27fc-4710-aa37-e946b97610ec tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:21.599731 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0157faaf-27fc-4710-aa37-e946b97610ec tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:21.660919 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-0157faaf-27fc-4710-aa37-e946b97610ec tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:21.668789 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-0157faaf-27fc-4710-aa37-e946b97610ec tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082313 Jun 22 09:25:21.670227 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 778/1510] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:21 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:22.687073 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1cada2a5-680e-45c1-a803-512f00413442 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:22.687796 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1cada2a5-680e-45c1-a803-512f00413442 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:22.694188 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1cada2a5-680e-45c1-a803-512f00413442 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:22.694633 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1cada2a5-680e-45c1-a803-512f00413442 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:22.695400 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1cada2a5-680e-45c1-a803-512f00413442 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:22.695835 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1cada2a5-680e-45c1-a803-512f00413442 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:22.762518 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-1cada2a5-680e-45c1-a803-512f00413442 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:22.770596 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1cada2a5-680e-45c1-a803-512f00413442 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.088088 Jun 22 09:25:22.771158 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 733/1511] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:22 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:23.788322 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-050dbac6-338a-408e-bf72-43a5a59b47a0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:23.788991 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-050dbac6-338a-408e-bf72-43a5a59b47a0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:23.796232 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-050dbac6-338a-408e-bf72-43a5a59b47a0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:23.796680 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-050dbac6-338a-408e-bf72-43a5a59b47a0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:23.797465 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-050dbac6-338a-408e-bf72-43a5a59b47a0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:23.797906 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-050dbac6-338a-408e-bf72-43a5a59b47a0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:23.858086 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-050dbac6-338a-408e-bf72-43a5a59b47a0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:23.866051 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-050dbac6-338a-408e-bf72-43a5a59b47a0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081584 Jun 22 09:25:23.866609 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 779/1512] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:23 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:24.883253 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c5b65b23-a9e8-4770-be3c-414a07b7859d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:24.884547 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c5b65b23-a9e8-4770-be3c-414a07b7859d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:24.892164 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c5b65b23-a9e8-4770-be3c-414a07b7859d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:24.892614 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c5b65b23-a9e8-4770-be3c-414a07b7859d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:24.893444 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c5b65b23-a9e8-4770-be3c-414a07b7859d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:24.893886 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c5b65b23-a9e8-4770-be3c-414a07b7859d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:24.954366 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-c5b65b23-a9e8-4770-be3c-414a07b7859d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:24.962219 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c5b65b23-a9e8-4770-be3c-414a07b7859d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082915 Jun 22 09:25:24.962780 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 734/1513] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:24 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:25.979590 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-effe1be0-844d-475f-afcb-ee445bf88fad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:25.980213 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-effe1be0-844d-475f-afcb-ee445bf88fad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:25.987407 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-effe1be0-844d-475f-afcb-ee445bf88fad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:25.987862 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-effe1be0-844d-475f-afcb-ee445bf88fad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:25.988629 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-effe1be0-844d-475f-afcb-ee445bf88fad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:25.989099 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-effe1be0-844d-475f-afcb-ee445bf88fad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:26.049503 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-effe1be0-844d-475f-afcb-ee445bf88fad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:26.057320 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-effe1be0-844d-475f-afcb-ee445bf88fad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081595 Jun 22 09:25:26.057881 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 780/1514] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:25 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:27.074231 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-cbc3d23a-b88f-4033-a480-8d2023587e45 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:27.074840 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-cbc3d23a-b88f-4033-a480-8d2023587e45 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:27.081978 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cbc3d23a-b88f-4033-a480-8d2023587e45 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:27.082423 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cbc3d23a-b88f-4033-a480-8d2023587e45 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:27.083267 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cbc3d23a-b88f-4033-a480-8d2023587e45 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:27.083703 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cbc3d23a-b88f-4033-a480-8d2023587e45 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:27.146390 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-cbc3d23a-b88f-4033-a480-8d2023587e45 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:27.154360 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-cbc3d23a-b88f-4033-a480-8d2023587e45 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083984 Jun 22 09:25:27.154947 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 735/1515] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:27 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:28.171403 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-62c05158-985b-44d4-8a10-7d42f2475b8d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:28.172019 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-62c05158-985b-44d4-8a10-7d42f2475b8d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:28.174725 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=28 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:25:28.179632 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-62c05158-985b-44d4-8a10-7d42f2475b8d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:28.180074 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-62c05158-985b-44d4-8a10-7d42f2475b8d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:28.180873 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-62c05158-985b-44d4-8a10-7d42f2475b8d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:28.181312 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-62c05158-985b-44d4-8a10-7d42f2475b8d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:28.246702 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-62c05158-985b-44d4-8a10-7d42f2475b8d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:28.257044 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-62c05158-985b-44d4-8a10-7d42f2475b8d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.089593 Jun 22 09:25:28.257599 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 781/1516] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:28 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:29.274644 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-89360adb-6526-4f85-8b3c-4a154e5ddc70 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:29.275324 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-89360adb-6526-4f85-8b3c-4a154e5ddc70 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:29.282231 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-89360adb-6526-4f85-8b3c-4a154e5ddc70 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:29.282677 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-89360adb-6526-4f85-8b3c-4a154e5ddc70 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:29.283434 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-89360adb-6526-4f85-8b3c-4a154e5ddc70 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:29.283868 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-89360adb-6526-4f85-8b3c-4a154e5ddc70 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:29.286484 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=84 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:25:29.345183 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-89360adb-6526-4f85-8b3c-4a154e5ddc70 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:29.353011 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-89360adb-6526-4f85-8b3c-4a154e5ddc70 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082309 Jun 22 09:25:29.353562 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 736/1517] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:29 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:30.370631 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-8178dad9-0366-4762-8d0e-57a6e018d2ad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:30.371246 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-8178dad9-0366-4762-8d0e-57a6e018d2ad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:30.380824 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8178dad9-0366-4762-8d0e-57a6e018d2ad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:30.381282 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8178dad9-0366-4762-8d0e-57a6e018d2ad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:30.382043 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8178dad9-0366-4762-8d0e-57a6e018d2ad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:30.382485 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8178dad9-0366-4762-8d0e-57a6e018d2ad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:30.386394 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=84 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:25:30.448158 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-8178dad9-0366-4762-8d0e-57a6e018d2ad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:30.456414 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-8178dad9-0366-4762-8d0e-57a6e018d2ad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.089702 Jun 22 09:25:30.457056 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 782/1518] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:30 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:31.473507 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-78215fcc-79fe-46df-a90e-9a8243846f1e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:31.474043 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-78215fcc-79fe-46df-a90e-9a8243846f1e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:31.476351 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=28 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:25:31.481146 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-78215fcc-79fe-46df-a90e-9a8243846f1e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:31.487885 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-78215fcc-79fe-46df-a90e-9a8243846f1e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:31.487885 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-78215fcc-79fe-46df-a90e-9a8243846f1e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:31.487885 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-78215fcc-79fe-46df-a90e-9a8243846f1e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:31.549598 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-78215fcc-79fe-46df-a90e-9a8243846f1e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:31.557487 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-78215fcc-79fe-46df-a90e-9a8243846f1e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.087920 Jun 22 09:25:31.558044 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 737/1519] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:31 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:32.575018 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-82a72f11-c7de-4371-8e43-880d1fb65064 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:32.575631 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-82a72f11-c7de-4371-8e43-880d1fb65064 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:32.582771 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-82a72f11-c7de-4371-8e43-880d1fb65064 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:32.583216 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-82a72f11-c7de-4371-8e43-880d1fb65064 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:32.583962 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-82a72f11-c7de-4371-8e43-880d1fb65064 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:32.584400 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-82a72f11-c7de-4371-8e43-880d1fb65064 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:32.645280 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-82a72f11-c7de-4371-8e43-880d1fb65064 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:32.653312 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-82a72f11-c7de-4371-8e43-880d1fb65064 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082145 Jun 22 09:25:32.659935 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 783/1520] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:32 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:33.671299 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-21569469-fbe2-4a54-9906-31ff2ce3a709 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:33.671926 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-21569469-fbe2-4a54-9906-31ff2ce3a709 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:33.678312 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-21569469-fbe2-4a54-9906-31ff2ce3a709 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:33.678759 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-21569469-fbe2-4a54-9906-31ff2ce3a709 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:33.679505 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-21569469-fbe2-4a54-9906-31ff2ce3a709 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:33.679934 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-21569469-fbe2-4a54-9906-31ff2ce3a709 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:33.740104 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-21569469-fbe2-4a54-9906-31ff2ce3a709 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:33.748271 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-21569469-fbe2-4a54-9906-31ff2ce3a709 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.080870 Jun 22 09:25:33.749855 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 738/1521] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:33 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:34.767056 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-6d24f489-b91d-40d7-b785-fbe8f8360f5d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:34.767673 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-6d24f489-b91d-40d7-b785-fbe8f8360f5d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:34.774305 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6d24f489-b91d-40d7-b785-fbe8f8360f5d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:34.774754 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6d24f489-b91d-40d7-b785-fbe8f8360f5d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:34.775515 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6d24f489-b91d-40d7-b785-fbe8f8360f5d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:34.775957 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6d24f489-b91d-40d7-b785-fbe8f8360f5d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:34.835872 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-6d24f489-b91d-40d7-b785-fbe8f8360f5d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:34.844388 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-6d24f489-b91d-40d7-b785-fbe8f8360f5d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081925 Jun 22 09:25:34.844972 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 784/1522] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:34 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:35.862468 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-386ae13d-8bf0-4dc9-bcdb-a3a015ba9cdc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:35.863143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-386ae13d-8bf0-4dc9-bcdb-a3a015ba9cdc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:35.869950 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-386ae13d-8bf0-4dc9-bcdb-a3a015ba9cdc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:35.870414 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-386ae13d-8bf0-4dc9-bcdb-a3a015ba9cdc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:35.871184 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-386ae13d-8bf0-4dc9-bcdb-a3a015ba9cdc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:35.871623 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-386ae13d-8bf0-4dc9-bcdb-a3a015ba9cdc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:35.937534 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-386ae13d-8bf0-4dc9-bcdb-a3a015ba9cdc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:35.945565 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-386ae13d-8bf0-4dc9-bcdb-a3a015ba9cdc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.088166 Jun 22 09:25:35.946133 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 739/1523] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:35 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:36.962299 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a30cd5a6-c41c-4993-ae3b-cc5cbace4b14 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:36.962910 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-a30cd5a6-c41c-4993-ae3b-cc5cbace4b14 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:36.970159 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a30cd5a6-c41c-4993-ae3b-cc5cbace4b14 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:36.970604 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a30cd5a6-c41c-4993-ae3b-cc5cbace4b14 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:36.971355 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a30cd5a6-c41c-4993-ae3b-cc5cbace4b14 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:36.971787 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a30cd5a6-c41c-4993-ae3b-cc5cbace4b14 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:37.033261 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-a30cd5a6-c41c-4993-ae3b-cc5cbace4b14 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:37.041216 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a30cd5a6-c41c-4993-ae3b-cc5cbace4b14 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082776 Jun 22 09:25:37.041772 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 785/1524] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:36 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:38.058455 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-d63abefe-639d-4861-914d-7d08b6b3cb73 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:38.059156 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-d63abefe-639d-4861-914d-7d08b6b3cb73 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:38.066224 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d63abefe-639d-4861-914d-7d08b6b3cb73 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:38.066672 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d63abefe-639d-4861-914d-7d08b6b3cb73 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:38.067431 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d63abefe-639d-4861-914d-7d08b6b3cb73 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:38.067870 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d63abefe-639d-4861-914d-7d08b6b3cb73 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:38.129129 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-d63abefe-639d-4861-914d-7d08b6b3cb73 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:38.137011 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-d63abefe-639d-4861-914d-7d08b6b3cb73 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082412 Jun 22 09:25:38.137566 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 740/1525] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:38 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:39.154519 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-3b885224-3c28-4136-91cd-9cecb6c0505e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:39.155779 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-3b885224-3c28-4136-91cd-9cecb6c0505e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:39.162278 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3b885224-3c28-4136-91cd-9cecb6c0505e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:39.162758 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3b885224-3c28-4136-91cd-9cecb6c0505e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:39.163518 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3b885224-3c28-4136-91cd-9cecb6c0505e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:39.163956 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3b885224-3c28-4136-91cd-9cecb6c0505e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:39.223831 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-3b885224-3c28-4136-91cd-9cecb6c0505e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:39.231936 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-3b885224-3c28-4136-91cd-9cecb6c0505e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081377 Jun 22 09:25:39.232550 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 786/1526] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:39 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:25:40.249791 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c15d24f8-d930-4a95-8ae8-3b257ec3858a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:40.250390 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c15d24f8-d930-4a95-8ae8-3b257ec3858a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:40.256563 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c15d24f8-d930-4a95-8ae8-3b257ec3858a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:40.257052 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c15d24f8-d930-4a95-8ae8-3b257ec3858a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:40.257800 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c15d24f8-d930-4a95-8ae8-3b257ec3858a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:40.258233 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c15d24f8-d930-4a95-8ae8-3b257ec3858a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:40.321569 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-c15d24f8-d930-4a95-8ae8-3b257ec3858a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:40.330076 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c15d24f8-d930-4a95-8ae8-3b257ec3858a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084940 Jun 22 09:25:40.330632 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 741/1527] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:40 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:41.350472 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-80b00b19-f345-4d02-8465-79c1081b5bd6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:41.351497 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-80b00b19-f345-4d02-8465-79c1081b5bd6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:41.358896 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-80b00b19-f345-4d02-8465-79c1081b5bd6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:41.359332 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-80b00b19-f345-4d02-8465-79c1081b5bd6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:41.360092 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-80b00b19-f345-4d02-8465-79c1081b5bd6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:41.360526 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-80b00b19-f345-4d02-8465-79c1081b5bd6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:41.430655 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-80b00b19-f345-4d02-8465-79c1081b5bd6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:41.438879 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-80b00b19-f345-4d02-8465-79c1081b5bd6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.095166 Jun 22 09:25:41.439453 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 787/1528] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:41 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:42.455378 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ebca2c07-b968-4bea-9f7a-348c0a4396d7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:42.455991 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ebca2c07-b968-4bea-9f7a-348c0a4396d7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:42.462492 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ebca2c07-b968-4bea-9f7a-348c0a4396d7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:42.462941 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ebca2c07-b968-4bea-9f7a-348c0a4396d7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:42.463700 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ebca2c07-b968-4bea-9f7a-348c0a4396d7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:42.464140 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ebca2c07-b968-4bea-9f7a-348c0a4396d7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:42.524578 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ebca2c07-b968-4bea-9f7a-348c0a4396d7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:42.533271 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ebca2c07-b968-4bea-9f7a-348c0a4396d7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081787 Jun 22 09:25:42.533836 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 742/1529] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:42 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:43.552429 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c8f25691-6eac-4c34-b43d-de0977a884cd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:43.553095 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c8f25691-6eac-4c34-b43d-de0977a884cd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:43.559595 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c8f25691-6eac-4c34-b43d-de0977a884cd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:43.560117 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c8f25691-6eac-4c34-b43d-de0977a884cd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:43.562328 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c8f25691-6eac-4c34-b43d-de0977a884cd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:43.562769 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c8f25691-6eac-4c34-b43d-de0977a884cd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:43.632168 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c8f25691-6eac-4c34-b43d-de0977a884cd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:43.640337 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c8f25691-6eac-4c34-b43d-de0977a884cd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.091952 Jun 22 09:25:43.641104 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 788/1530] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:43 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:44.658248 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-84800651-1931-4dcd-8420-579ab75ed90c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:44.658866 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-84800651-1931-4dcd-8420-579ab75ed90c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:44.665387 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-84800651-1931-4dcd-8420-579ab75ed90c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:44.665840 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-84800651-1931-4dcd-8420-579ab75ed90c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:44.666605 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-84800651-1931-4dcd-8420-579ab75ed90c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:44.667047 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-84800651-1931-4dcd-8420-579ab75ed90c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:44.730163 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-84800651-1931-4dcd-8420-579ab75ed90c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:44.738387 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-84800651-1931-4dcd-8420-579ab75ed90c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084815 Jun 22 09:25:44.738956 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 743/1531] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:44 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:45.755382 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-ca2e62c0-3f1c-4117-a435-e5fa2816bf17 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:45.756025 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-ca2e62c0-3f1c-4117-a435-e5fa2816bf17 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:45.762690 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ca2e62c0-3f1c-4117-a435-e5fa2816bf17 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:45.763141 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ca2e62c0-3f1c-4117-a435-e5fa2816bf17 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:45.764039 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ca2e62c0-3f1c-4117-a435-e5fa2816bf17 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:45.764484 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ca2e62c0-3f1c-4117-a435-e5fa2816bf17 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:45.824699 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-ca2e62c0-3f1c-4117-a435-e5fa2816bf17 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:45.833209 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-ca2e62c0-3f1c-4117-a435-e5fa2816bf17 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081662 Jun 22 09:25:45.833766 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 789/1532] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:45 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:46.850998 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-877ffad4-2a23-480c-927e-d61b8fe53da7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:46.851593 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-877ffad4-2a23-480c-927e-d61b8fe53da7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:46.858628 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-877ffad4-2a23-480c-927e-d61b8fe53da7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:46.859069 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-877ffad4-2a23-480c-927e-d61b8fe53da7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:46.859820 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-877ffad4-2a23-480c-927e-d61b8fe53da7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:46.860251 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-877ffad4-2a23-480c-927e-d61b8fe53da7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:46.923024 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-877ffad4-2a23-480c-927e-d61b8fe53da7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:46.930828 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-877ffad4-2a23-480c-927e-d61b8fe53da7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083764 Jun 22 09:25:46.931385 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 744/1533] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:46 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:47.948692 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d736ab5c-34cb-4700-9b42-d26048203179 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:47.949350 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-d736ab5c-34cb-4700-9b42-d26048203179 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:47.956673 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d736ab5c-34cb-4700-9b42-d26048203179 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:47.957162 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d736ab5c-34cb-4700-9b42-d26048203179 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:47.957924 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d736ab5c-34cb-4700-9b42-d26048203179 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:47.958367 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d736ab5c-34cb-4700-9b42-d26048203179 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:48.018931 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-d736ab5c-34cb-4700-9b42-d26048203179 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:48.026830 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d736ab5c-34cb-4700-9b42-d26048203179 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082026 Jun 22 09:25:48.027425 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 790/1534] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:47 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:49.044125 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-23a8afea-6058-4c1d-9703-ef0ed4aee6c5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:49.044743 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-23a8afea-6058-4c1d-9703-ef0ed4aee6c5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:49.051342 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-23a8afea-6058-4c1d-9703-ef0ed4aee6c5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:49.051784 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-23a8afea-6058-4c1d-9703-ef0ed4aee6c5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:49.052538 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-23a8afea-6058-4c1d-9703-ef0ed4aee6c5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:49.053006 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-23a8afea-6058-4c1d-9703-ef0ed4aee6c5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:49.114862 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-23a8afea-6058-4c1d-9703-ef0ed4aee6c5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:49.123160 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-23a8afea-6058-4c1d-9703-ef0ed4aee6c5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082740 Jun 22 09:25:49.123734 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 745/1535] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:49 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:50.140215 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-ba38c75b-11a0-498d-a38b-1a6a86a81849 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:50.140997 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-ba38c75b-11a0-498d-a38b-1a6a86a81849 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:50.147647 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ba38c75b-11a0-498d-a38b-1a6a86a81849 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:50.148105 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ba38c75b-11a0-498d-a38b-1a6a86a81849 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:50.148903 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ba38c75b-11a0-498d-a38b-1a6a86a81849 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:50.149351 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ba38c75b-11a0-498d-a38b-1a6a86a81849 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:50.210072 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-ba38c75b-11a0-498d-a38b-1a6a86a81849 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:50.218626 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-ba38c75b-11a0-498d-a38b-1a6a86a81849 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082735 Jun 22 09:25:50.219191 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 791/1536] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:50 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:51.235664 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6d572eec-fe40-4a03-88dd-1655618aa2da tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:51.237774 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-6d572eec-fe40-4a03-88dd-1655618aa2da tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:51.242843 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6d572eec-fe40-4a03-88dd-1655618aa2da tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:51.243299 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6d572eec-fe40-4a03-88dd-1655618aa2da tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:51.244116 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6d572eec-fe40-4a03-88dd-1655618aa2da tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:51.244561 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6d572eec-fe40-4a03-88dd-1655618aa2da tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:51.306623 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-6d572eec-fe40-4a03-88dd-1655618aa2da tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:51.314759 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-6d572eec-fe40-4a03-88dd-1655618aa2da tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083111 Jun 22 09:25:51.315328 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 746/1537] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:51 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:52.332116 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-77423558-d78f-4df2-8770-97ba79c8d16d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:52.332727 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-77423558-d78f-4df2-8770-97ba79c8d16d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:52.339283 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-77423558-d78f-4df2-8770-97ba79c8d16d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:52.339779 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-77423558-d78f-4df2-8770-97ba79c8d16d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:52.340526 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-77423558-d78f-4df2-8770-97ba79c8d16d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:52.341010 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-77423558-d78f-4df2-8770-97ba79c8d16d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:52.403340 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-77423558-d78f-4df2-8770-97ba79c8d16d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:52.411480 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-77423558-d78f-4df2-8770-97ba79c8d16d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083189 Jun 22 09:25:52.412210 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 792/1538] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:52 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:53.427346 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3a638d34-58d2-4b90-baa6-4aa7f1da351b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:53.427992 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3a638d34-58d2-4b90-baa6-4aa7f1da351b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:53.434482 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3a638d34-58d2-4b90-baa6-4aa7f1da351b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:53.434935 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3a638d34-58d2-4b90-baa6-4aa7f1da351b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:53.435727 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3a638d34-58d2-4b90-baa6-4aa7f1da351b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:53.436157 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3a638d34-58d2-4b90-baa6-4aa7f1da351b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:53.499597 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3a638d34-58d2-4b90-baa6-4aa7f1da351b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:53.507785 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3a638d34-58d2-4b90-baa6-4aa7f1da351b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084328 Jun 22 09:25:53.508404 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 747/1539] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:53 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:54.524906 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-69b9ec42-7f94-4088-94f3-c59b9bc2a9ac tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:54.525436 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-69b9ec42-7f94-4088-94f3-c59b9bc2a9ac tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:54.531827 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-69b9ec42-7f94-4088-94f3-c59b9bc2a9ac tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:54.532273 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-69b9ec42-7f94-4088-94f3-c59b9bc2a9ac tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:54.533056 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-69b9ec42-7f94-4088-94f3-c59b9bc2a9ac tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:54.533494 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-69b9ec42-7f94-4088-94f3-c59b9bc2a9ac tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:54.595532 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-69b9ec42-7f94-4088-94f3-c59b9bc2a9ac tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:54.603387 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-69b9ec42-7f94-4088-94f3-c59b9bc2a9ac tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082505 Jun 22 09:25:54.603937 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 793/1540] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:54 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:55.620175 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-75676d8d-9716-4224-839f-4911a16452ce tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:55.620803 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-75676d8d-9716-4224-839f-4911a16452ce tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:55.627818 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-75676d8d-9716-4224-839f-4911a16452ce tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:55.628269 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-75676d8d-9716-4224-839f-4911a16452ce tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:55.629057 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-75676d8d-9716-4224-839f-4911a16452ce tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:55.629498 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-75676d8d-9716-4224-839f-4911a16452ce tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:55.690656 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-75676d8d-9716-4224-839f-4911a16452ce tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:55.698657 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-75676d8d-9716-4224-839f-4911a16452ce tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082402 Jun 22 09:25:55.699215 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 748/1541] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:55 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:56.716000 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-58707302-a9c0-4b4c-90eb-b9f3bd3de70b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:56.717191 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-58707302-a9c0-4b4c-90eb-b9f3bd3de70b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:56.723710 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-58707302-a9c0-4b4c-90eb-b9f3bd3de70b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:56.724152 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-58707302-a9c0-4b4c-90eb-b9f3bd3de70b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:56.724930 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-58707302-a9c0-4b4c-90eb-b9f3bd3de70b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:56.725368 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-58707302-a9c0-4b4c-90eb-b9f3bd3de70b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:56.785777 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-58707302-a9c0-4b4c-90eb-b9f3bd3de70b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:56.793977 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-58707302-a9c0-4b4c-90eb-b9f3bd3de70b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081829 Jun 22 09:25:56.795377 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 794/1542] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:56 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:57.811957 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-8a7ff99a-3bb5-421b-a414-ba94488b8977 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:57.812576 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-8a7ff99a-3bb5-421b-a414-ba94488b8977 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:57.819250 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8a7ff99a-3bb5-421b-a414-ba94488b8977 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:57.819713 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8a7ff99a-3bb5-421b-a414-ba94488b8977 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:57.820466 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8a7ff99a-3bb5-421b-a414-ba94488b8977 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:57.820931 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8a7ff99a-3bb5-421b-a414-ba94488b8977 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:57.885384 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-8a7ff99a-3bb5-421b-a414-ba94488b8977 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:57.893844 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-8a7ff99a-3bb5-421b-a414-ba94488b8977 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.085849 Jun 22 09:25:57.894403 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 749/1543] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:57 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:58.910436 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a533bea3-3e6f-4713-b3b9-b9394b014d6e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:58.911076 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-a533bea3-3e6f-4713-b3b9-b9394b014d6e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:58.913436 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=28 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:25:58.918237 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a533bea3-3e6f-4713-b3b9-b9394b014d6e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:58.918683 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a533bea3-3e6f-4713-b3b9-b9394b014d6e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:58.919439 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a533bea3-3e6f-4713-b3b9-b9394b014d6e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:58.920267 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a533bea3-3e6f-4713-b3b9-b9394b014d6e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:58.981848 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-a533bea3-3e6f-4713-b3b9-b9394b014d6e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:58.990643 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a533bea3-3e6f-4713-b3b9-b9394b014d6e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084071 Jun 22 09:25:58.991200 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 795/1544] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:58 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:25:59.380591 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-2872f613-5fb3-435f-9140-65f828f63cba tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:59.381142 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-2872f613-5fb3-435f-9140-65f828f63cba tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: 46fa6d8c-afd7-4385-a727-ee8d14223669] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:59.387418 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2872f613-5fb3-435f-9140-65f828f63cba tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:59.390285 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2872f613-5fb3-435f-9140-65f828f63cba tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:59.390285 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2872f613-5fb3-435f-9140-65f828f63cba tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:59.392429 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2872f613-5fb3-435f-9140-65f828f63cba tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:59.396644 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=84 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:25:59.422882 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-2872f613-5fb3-435f-9140-65f828f63cba tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: 46fa6d8c-afd7-4385-a727-ee8d14223669] Going to try to terminate instance {{(pid=118024) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:25:59.675807 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-2872f613-5fb3-435f-9140-65f828f63cba tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "DELETE /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669" status: 204 len: 0 microversion: 2.1 time: 0.298710 Jun 22 09:25:59.676378 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 750/1545] 10.222.0.16 () {58 vars in 1238 bytes} [Wed Jun 22 09:25:59 2022] DELETE /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:25:59.684488 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a7439f87-0cc0-4211-951d-f7427cdb80b8 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:25:59.685133 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-a7439f87-0cc0-4211-951d-f7427cdb80b8 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: 46fa6d8c-afd7-4385-a727-ee8d14223669] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:25:59.692186 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a7439f87-0cc0-4211-951d-f7427cdb80b8 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:59.693230 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a7439f87-0cc0-4211-951d-f7427cdb80b8 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:59.693462 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a7439f87-0cc0-4211-951d-f7427cdb80b8 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:25:59.693894 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a7439f87-0cc0-4211-951d-f7427cdb80b8 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:25:59.819799 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-a7439f87-0cc0-4211-951d-f7427cdb80b8 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:25:59.827238 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a7439f87-0cc0-4211-951d-f7427cdb80b8 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669" status: 200 len: 1679 microversion: 2.1 time: 0.146552 Jun 22 09:25:59.828613 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 796/1546] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:25:59 2022] GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:26:00.016233 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-9f1d5463-3aa9-4f8a-9eae-aad44540d45f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:00.016878 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-9f1d5463-3aa9-4f8a-9eae-aad44540d45f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:00.023118 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9f1d5463-3aa9-4f8a-9eae-aad44540d45f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:00.023562 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9f1d5463-3aa9-4f8a-9eae-aad44540d45f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:00.024339 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9f1d5463-3aa9-4f8a-9eae-aad44540d45f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:00.024872 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9f1d5463-3aa9-4f8a-9eae-aad44540d45f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:00.090662 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-9f1d5463-3aa9-4f8a-9eae-aad44540d45f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:00.098843 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-9f1d5463-3aa9-4f8a-9eae-aad44540d45f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.087868 Jun 22 09:26:00.099398 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 751/1547] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:00 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:00.847104 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-8829e78c-fe53-449f-a044-41befe26e540 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:00.847666 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-8829e78c-fe53-449f-a044-41befe26e540 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: 46fa6d8c-afd7-4385-a727-ee8d14223669] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:00.854382 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8829e78c-fe53-449f-a044-41befe26e540 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:00.854833 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8829e78c-fe53-449f-a044-41befe26e540 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:00.855605 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8829e78c-fe53-449f-a044-41befe26e540 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:00.856046 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8829e78c-fe53-449f-a044-41befe26e540 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:00.860819 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=90 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:00.986120 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-8829e78c-fe53-449f-a044-41befe26e540 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:00.994102 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-8829e78c-fe53-449f-a044-41befe26e540 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669" status: 200 len: 1679 microversion: 2.1 time: 0.152544 Jun 22 09:26:00.994665 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 797/1548] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:00 2022] GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:01.116592 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-cf229d85-4565-4b8b-bbd8-d584570438c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:01.124201 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-cf229d85-4565-4b8b-bbd8-d584570438c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:01.124201 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cf229d85-4565-4b8b-bbd8-d584570438c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:01.124201 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cf229d85-4565-4b8b-bbd8-d584570438c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:01.125096 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cf229d85-4565-4b8b-bbd8-d584570438c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:01.126034 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cf229d85-4565-4b8b-bbd8-d584570438c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:01.190422 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-cf229d85-4565-4b8b-bbd8-d584570438c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:01.198902 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-cf229d85-4565-4b8b-bbd8-d584570438c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.086117 Jun 22 09:26:01.199478 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 752/1549] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:01 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:01.419578 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-bf9b5689-c8d4-47d9-a7cd-dbc9f8d8a44a req-ce989b5e-8e51-48f0-8e33-0e8ff0189736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46fa6d8c-afd7-4385-a727-ee8d14223669", "name": "network-vif-deleted", "tag": "566d62a3-e2c4-4f86-b042-d41e7f9f5f68"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:26:01.428041 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-bf9b5689-c8d4-47d9-a7cd-dbc9f8d8a44a req-ce989b5e-8e51-48f0-8e33-0e8ff0189736 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:01.428388 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-bf9b5689-c8d4-47d9-a7cd-dbc9f8d8a44a req-ce989b5e-8e51-48f0-8e33-0e8ff0189736 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:01.440427 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-bf9b5689-c8d4-47d9-a7cd-dbc9f8d8a44a req-ce989b5e-8e51-48f0-8e33-0e8ff0189736 service nova] Creating event network-vif-deleted:566d62a3-e2c4-4f86-b042-d41e7f9f5f68 for instance 46fa6d8c-afd7-4385-a727-ee8d14223669 on hv-cinder-84599 Jun 22 09:26:01.445950 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-bf9b5689-c8d4-47d9-a7cd-dbc9f8d8a44a req-ce989b5e-8e51-48f0-8e33-0e8ff0189736 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030021 Jun 22 09:26:01.449540 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 798/1550] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:26:02.011680 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-9d43458c-1357-40b9-89d8-8d23130122d6 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:02.012374 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-9d43458c-1357-40b9-89d8-8d23130122d6 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: 46fa6d8c-afd7-4385-a727-ee8d14223669] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:02.014389 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:02.019312 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9d43458c-1357-40b9-89d8-8d23130122d6 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:02.019755 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9d43458c-1357-40b9-89d8-8d23130122d6 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:02.020521 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9d43458c-1357-40b9-89d8-8d23130122d6 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:02.020995 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9d43458c-1357-40b9-89d8-8d23130122d6 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:02.054290 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9d43458c-1357-40b9-89d8-8d23130122d6 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:02.054831 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9d43458c-1357-40b9-89d8-8d23130122d6 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:02.055350 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.objects.instance [None req-9d43458c-1357-40b9-89d8-8d23130122d6 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lazy-loading 'fault' on Instance uuid 46fa6d8c-afd7-4385-a727-ee8d14223669 {{(pid=118024) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:26:02.101613 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-9d43458c-1357-40b9-89d8-8d23130122d6 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ea2610ccc044de9d66444b4038fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebdcb9809a84f25bd578f8aca09802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:02.110055 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-9d43458c-1357-40b9-89d8-8d23130122d6 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669" status: 200 len: 1330 microversion: 2.1 time: 0.102443 Jun 22 09:26:02.115454 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 753/1551] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:02 2022] GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669 => generated 1330 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:02.217152 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-508e1adc-785e-4979-9391-a0606305750a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:02.223768 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-508e1adc-785e-4979-9391-a0606305750a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:02.226134 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-508e1adc-785e-4979-9391-a0606305750a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:02.226591 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-508e1adc-785e-4979-9391-a0606305750a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:02.227431 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-508e1adc-785e-4979-9391-a0606305750a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:02.227852 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-508e1adc-785e-4979-9391-a0606305750a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:02.293475 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-508e1adc-785e-4979-9391-a0606305750a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:02.301588 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-508e1adc-785e-4979-9391-a0606305750a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.089762 Jun 22 09:26:02.302159 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 799/1552] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:02 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:03.129626 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-95385f5c-529d-4407-8d14-383134a6fd2e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:03.130315 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-95385f5c-529d-4407-8d14-383134a6fd2e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: 46fa6d8c-afd7-4385-a727-ee8d14223669] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:03.137064 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-95385f5c-529d-4407-8d14-383134a6fd2e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:03.137629 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-95385f5c-529d-4407-8d14-383134a6fd2e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:03.138397 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-95385f5c-529d-4407-8d14-383134a6fd2e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:03.138832 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-95385f5c-529d-4407-8d14-383134a6fd2e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:03.152395 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.wsgi [None req-95385f5c-529d-4407-8d14-383134a6fd2e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] HTTP exception thrown: Instance 46fa6d8c-afd7-4385-a727-ee8d14223669 could not be found. Jun 22 09:26:03.154030 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-95385f5c-529d-4407-8d14-383134a6fd2e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Request method failure captured: Jun 22 09:26:03.154030 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: request: GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669 HTTP/1.1 Jun 22 09:26:03.154030 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept: application/json Jun 22 09:26:03.154030 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept-Encoding: identity Jun 22 09:26:03.154030 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Connection: close Jun 22 09:26:03.154030 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Length: 0 Jun 22 09:26:03.154030 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Type: application/json Jun 22 09:26:03.154030 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Host: 10.222.0.16 Jun 22 09:26:03.154030 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Openstack-System-Scope: None Jun 22 09:26:03.154030 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: User-Agent: python-urllib3/1.26.9 Jun 22 09:26:03.154030 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Auth-Token: gAAAAABistmqD47tOpCEfZxXQ7v8d4kDBzbZcFIWDuyhnuGnU13mxMlhbgt18xo2M0HJq-gXeYBWo0pfkDLuGB3yaG8TUwjVHhSVzhHn4vsUiwL4uQjCeCtk_V7_A6rYsksudlP-79icDu6EqbcTRNIwpnAGEp7HhBlOtNGTaFEH_UUlynGlRmI Jun 22 09:26:03.154030 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Id: None Jun 22 09:26:03.154030 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Name: None Jun 22 09:26:03.154030 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Identity-Status: Confirmed Jun 22 09:26:03.154030 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Is-Admin-Project: True Jun 22 09:26:03.154030 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Id: default Jun 22 09:26:03.154030 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Name: Default Jun 22 09:26:03.154030 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Id: 9ebdcb9809a84f25bd578f8aca09802c Jun 22 09:26:03.154030 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Name: tempest-AttachVolumeNegativeTest-914919780 Jun 22 09:26:03.154030 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Role: member,reader Jun 22 09:26:03.154030 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Roles: member,reader Jun 22 09:26:03.155840 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebdcb9809a84f25bd578f8aca09802c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebdcb9809a84f25bd578f8aca09802c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ebdcb9809a84f25bd578f8aca09802c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ebdcb9809a84f25bd578f8aca09802c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:26:03.155840 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant: tempest-AttachVolumeNegativeTest-914919780 Jun 22 09:26:03.155840 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Id: 9ebdcb9809a84f25bd578f8aca09802c Jun 22 09:26:03.155840 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-914919780 Jun 22 09:26:03.155840 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User: tempest-AttachVolumeNegativeTest-914919780-project Jun 22 09:26:03.155840 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Id: default Jun 22 09:26:03.155840 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Name: Default Jun 22 09:26:03.155840 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Id: 71ea2610ccc044de9d66444b4038fe9e Jun 22 09:26:03.155840 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Name: tempest-AttachVolumeNegativeTest-914919780-project Jun 22 09:26:03.155840 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: method: > Jun 22 09:26:03.155840 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: exception: Instance 46fa6d8c-afd7-4385-a727-ee8d14223669 could not be found. Jun 22 09:26:03.155840 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: action_args: {'id': '46fa6d8c-afd7-4385-a727-ee8d14223669'} Jun 22 09:26:03.157065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:26:03.157065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:26:03.157065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:26:03.157065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:26:03.157065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:26:03.157065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:26:03.157065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:26:03.157065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:26:03.157065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:26:03.157065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:26:03.157065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46fa6d8c-afd7-4385-a727-ee8d14223669 could not be found. Jun 22 09:26:03.157065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:26:03.157065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:26:03.157065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:26:03.157065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:26:03.157065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:26:03.157065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:26:03.157065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:26:03.157065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:26:03.157065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:26:03.158960 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:26:03.158960 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:26:03.158960 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:26:03.158960 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:26:03.158960 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:26:03.158960 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:26:03.158960 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:26:03.158960 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46fa6d8c-afd7-4385-a727-ee8d14223669 could not be found. Jun 22 09:26:03.158960 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:26:03.158960 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:26:03.158960 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:26:03.158960 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:26:03.158960 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:26:03.158960 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:26:03.158960 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:26:03.158960 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:26:03.158960 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46fa6d8c-afd7-4385-a727-ee8d14223669 could not be found. Jun 22 09:26:03.158960 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:26:03.160698 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-95385f5c-529d-4407-8d14-383134a6fd2e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Returning 404 to user: Instance 46fa6d8c-afd7-4385-a727-ee8d14223669 could not be found. {{(pid=118024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:26:03.160698 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-95385f5c-529d-4407-8d14-383134a6fd2e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669" status: 404 len: 111 microversion: 2.1 time: 0.030413 Jun 22 09:26:03.160698 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 754/1553] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:03 2022] GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:26:03.164298 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-59c2c883-8639-4cd5-90fc-666641edaed2 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '.version_select at 0x7f57560543a0>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:03.265226 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-59c2c883-8639-4cd5-90fc-666641edaed2 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-927026018" status: 202 len: 0 microversion: 2.1 time: 0.104617 Jun 22 09:26:03.265910 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 800/1554] 10.222.0.16 () {58 vars in 1217 bytes} [Wed Jun 22 09:26:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-927026018 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:26:03.319320 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-99648101-9d8e-4ff9-9458-a0e65001c87f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:03.319999 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-99648101-9d8e-4ff9-9458-a0e65001c87f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:03.326228 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-99648101-9d8e-4ff9-9458-a0e65001c87f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:03.326677 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-99648101-9d8e-4ff9-9458-a0e65001c87f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:03.327432 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-99648101-9d8e-4ff9-9458-a0e65001c87f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:03.327867 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-99648101-9d8e-4ff9-9458-a0e65001c87f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:03.409168 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-99648101-9d8e-4ff9-9458-a0e65001c87f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:03.423805 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-99648101-9d8e-4ff9-9458-a0e65001c87f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.101825 Jun 22 09:26:03.423805 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 755/1555] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:03 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:04.434681 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f7533d4b-2191-449a-8e43-f4110aebf4d2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:04.435326 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-f7533d4b-2191-449a-8e43-f4110aebf4d2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:04.442680 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f7533d4b-2191-449a-8e43-f4110aebf4d2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:04.443226 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f7533d4b-2191-449a-8e43-f4110aebf4d2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:04.444026 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f7533d4b-2191-449a-8e43-f4110aebf4d2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:04.444468 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f7533d4b-2191-449a-8e43-f4110aebf4d2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:04.506163 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-f7533d4b-2191-449a-8e43-f4110aebf4d2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:04.514028 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f7533d4b-2191-449a-8e43-f4110aebf4d2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083728 Jun 22 09:26:04.514580 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 801/1556] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:04 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:05.530872 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-dd4aa44c-9bf3-47de-88b5-571458b09122 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:05.531426 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-dd4aa44c-9bf3-47de-88b5-571458b09122 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:05.538668 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dd4aa44c-9bf3-47de-88b5-571458b09122 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:05.539122 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dd4aa44c-9bf3-47de-88b5-571458b09122 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:05.539936 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dd4aa44c-9bf3-47de-88b5-571458b09122 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:05.540380 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dd4aa44c-9bf3-47de-88b5-571458b09122 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:05.601389 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-dd4aa44c-9bf3-47de-88b5-571458b09122 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:05.609293 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-dd4aa44c-9bf3-47de-88b5-571458b09122 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082396 Jun 22 09:26:05.609850 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 756/1557] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:05 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:06.627417 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-4379c03d-b800-4f59-bf56-ad2536dfb7bd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:06.628034 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-4379c03d-b800-4f59-bf56-ad2536dfb7bd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:06.634284 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4379c03d-b800-4f59-bf56-ad2536dfb7bd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:06.634734 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4379c03d-b800-4f59-bf56-ad2536dfb7bd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:06.635492 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4379c03d-b800-4f59-bf56-ad2536dfb7bd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:06.635931 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4379c03d-b800-4f59-bf56-ad2536dfb7bd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:06.697558 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-4379c03d-b800-4f59-bf56-ad2536dfb7bd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:06.706399 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-4379c03d-b800-4f59-bf56-ad2536dfb7bd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083561 Jun 22 09:26:06.706962 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 802/1558] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:06 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:07.723291 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-d1ad13c7-e34d-4037-9729-be63a9d1ff66 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:07.723905 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-d1ad13c7-e34d-4037-9729-be63a9d1ff66 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:07.730440 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d1ad13c7-e34d-4037-9729-be63a9d1ff66 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:07.730887 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d1ad13c7-e34d-4037-9729-be63a9d1ff66 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:07.731649 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d1ad13c7-e34d-4037-9729-be63a9d1ff66 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:07.732086 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d1ad13c7-e34d-4037-9729-be63a9d1ff66 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:07.797820 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-d1ad13c7-e34d-4037-9729-be63a9d1ff66 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:07.805952 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-d1ad13c7-e34d-4037-9729-be63a9d1ff66 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.087260 Jun 22 09:26:07.806514 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 757/1559] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:07 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:08.823010 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-743fd443-b785-462c-a9b9-bf551b988fab tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:08.823683 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-743fd443-b785-462c-a9b9-bf551b988fab tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:08.831543 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-743fd443-b785-462c-a9b9-bf551b988fab tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:08.831997 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-743fd443-b785-462c-a9b9-bf551b988fab tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:08.832808 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-743fd443-b785-462c-a9b9-bf551b988fab tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:08.833252 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-743fd443-b785-462c-a9b9-bf551b988fab tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:08.897817 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-743fd443-b785-462c-a9b9-bf551b988fab tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:08.905829 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-743fd443-b785-462c-a9b9-bf551b988fab tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.086717 Jun 22 09:26:08.906397 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 803/1560] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:08 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:09.922919 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b71e6353-0d1f-450c-9853-dd04ec2f2eb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:09.923635 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-b71e6353-0d1f-450c-9853-dd04ec2f2eb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:09.930036 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b71e6353-0d1f-450c-9853-dd04ec2f2eb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:09.930485 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b71e6353-0d1f-450c-9853-dd04ec2f2eb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:09.931239 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b71e6353-0d1f-450c-9853-dd04ec2f2eb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:09.931673 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b71e6353-0d1f-450c-9853-dd04ec2f2eb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:09.993388 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-b71e6353-0d1f-450c-9853-dd04ec2f2eb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:10.001574 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-b71e6353-0d1f-450c-9853-dd04ec2f2eb3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082587 Jun 22 09:26:10.002139 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 758/1561] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:09 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:11.017634 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a2564bfe-289d-4a62-8457-4d7fd995d718 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:11.018254 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-a2564bfe-289d-4a62-8457-4d7fd995d718 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:11.024479 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a2564bfe-289d-4a62-8457-4d7fd995d718 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:11.024968 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a2564bfe-289d-4a62-8457-4d7fd995d718 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:11.025731 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a2564bfe-289d-4a62-8457-4d7fd995d718 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:11.026170 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a2564bfe-289d-4a62-8457-4d7fd995d718 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:11.086077 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-a2564bfe-289d-4a62-8457-4d7fd995d718 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:11.093986 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a2564bfe-289d-4a62-8457-4d7fd995d718 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.080345 Jun 22 09:26:11.094546 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 804/1562] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:11 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:12.111470 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3dfb4cbd-2312-46b5-a873-79fed94515e3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:12.112107 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3dfb4cbd-2312-46b5-a873-79fed94515e3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:12.120474 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3dfb4cbd-2312-46b5-a873-79fed94515e3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:12.120957 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3dfb4cbd-2312-46b5-a873-79fed94515e3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:12.121717 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3dfb4cbd-2312-46b5-a873-79fed94515e3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:12.122151 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3dfb4cbd-2312-46b5-a873-79fed94515e3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:12.186226 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3dfb4cbd-2312-46b5-a873-79fed94515e3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:12.195297 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3dfb4cbd-2312-46b5-a873-79fed94515e3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.087672 Jun 22 09:26:12.195866 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 759/1563] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:12 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:13.211434 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-21a69e4e-22d0-46f8-aad3-b2c8e0ebae8e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:13.212027 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-21a69e4e-22d0-46f8-aad3-b2c8e0ebae8e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:13.218652 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-21a69e4e-22d0-46f8-aad3-b2c8e0ebae8e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:13.219095 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-21a69e4e-22d0-46f8-aad3-b2c8e0ebae8e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:13.220642 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-21a69e4e-22d0-46f8-aad3-b2c8e0ebae8e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:13.221201 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-21a69e4e-22d0-46f8-aad3-b2c8e0ebae8e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:13.283388 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-21a69e4e-22d0-46f8-aad3-b2c8e0ebae8e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:13.291567 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-21a69e4e-22d0-46f8-aad3-b2c8e0ebae8e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084016 Jun 22 09:26:13.292118 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 805/1564] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:13 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:14.309448 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f1598afd-960e-4685-95db-5cbe4afb4f30 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:14.310057 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f1598afd-960e-4685-95db-5cbe4afb4f30 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:14.316520 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f1598afd-960e-4685-95db-5cbe4afb4f30 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:14.316998 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f1598afd-960e-4685-95db-5cbe4afb4f30 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:14.317750 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f1598afd-960e-4685-95db-5cbe4afb4f30 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:14.318183 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f1598afd-960e-4685-95db-5cbe4afb4f30 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:14.376495 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:26:14.376759 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Wed Jun 22 09:26:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 (ip 10.222.0.16) !!! Jun 22 09:26:14.380227 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-f1598afd-960e-4685-95db-5cbe4afb4f30 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:14.390569 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f1598afd-960e-4685-95db-5cbe4afb4f30 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084949 Jun 22 09:26:14.397449 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 760/1565] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:14 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:15.408341 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-1f3dacde-854f-4edb-a0a2-6d829d5edc5a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:15.408997 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-1f3dacde-854f-4edb-a0a2-6d829d5edc5a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:15.415551 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1f3dacde-854f-4edb-a0a2-6d829d5edc5a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:15.416005 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1f3dacde-854f-4edb-a0a2-6d829d5edc5a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:15.416810 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1f3dacde-854f-4edb-a0a2-6d829d5edc5a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:15.417248 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1f3dacde-854f-4edb-a0a2-6d829d5edc5a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:15.479446 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-1f3dacde-854f-4edb-a0a2-6d829d5edc5a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:15.487361 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-1f3dacde-854f-4edb-a0a2-6d829d5edc5a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082915 Jun 22 09:26:15.487920 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 806/1566] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:15 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:16.505090 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-52f116a9-609d-49ff-b7ac-6cf73db2a056 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:16.506125 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-52f116a9-609d-49ff-b7ac-6cf73db2a056 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:16.512287 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-52f116a9-609d-49ff-b7ac-6cf73db2a056 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:16.512773 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-52f116a9-609d-49ff-b7ac-6cf73db2a056 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:16.513565 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-52f116a9-609d-49ff-b7ac-6cf73db2a056 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:16.513996 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-52f116a9-609d-49ff-b7ac-6cf73db2a056 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:16.578539 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-52f116a9-609d-49ff-b7ac-6cf73db2a056 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:16.586691 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-52f116a9-609d-49ff-b7ac-6cf73db2a056 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.086155 Jun 22 09:26:16.587251 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 761/1567] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:16 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:26:17.603590 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2783ef97-ba85-4fdf-a3ec-d9737407afa5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:17.604158 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2783ef97-ba85-4fdf-a3ec-d9737407afa5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:17.610669 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2783ef97-ba85-4fdf-a3ec-d9737407afa5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:17.611114 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2783ef97-ba85-4fdf-a3ec-d9737407afa5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:17.611865 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2783ef97-ba85-4fdf-a3ec-d9737407afa5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:17.612297 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2783ef97-ba85-4fdf-a3ec-d9737407afa5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:17.673242 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-2783ef97-ba85-4fdf-a3ec-d9737407afa5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:17.681256 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2783ef97-ba85-4fdf-a3ec-d9737407afa5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081694 Jun 22 09:26:17.681813 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 807/1568] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:17 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:18.698309 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-523c6984-95c3-4896-bea4-41640dc02693 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:18.698925 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-523c6984-95c3-4896-bea4-41640dc02693 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:18.705361 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-523c6984-95c3-4896-bea4-41640dc02693 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:18.705810 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-523c6984-95c3-4896-bea4-41640dc02693 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:18.706558 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-523c6984-95c3-4896-bea4-41640dc02693 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:18.706990 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-523c6984-95c3-4896-bea4-41640dc02693 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:18.767527 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-523c6984-95c3-4896-bea4-41640dc02693 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:18.775627 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-523c6984-95c3-4896-bea4-41640dc02693 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081226 Jun 22 09:26:18.776184 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 762/1569] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:18 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:19.792772 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-5629edcd-0dfa-4de5-b590-1f5e6aec42cc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:19.793407 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-5629edcd-0dfa-4de5-b590-1f5e6aec42cc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:19.800016 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5629edcd-0dfa-4de5-b590-1f5e6aec42cc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:19.800605 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5629edcd-0dfa-4de5-b590-1f5e6aec42cc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:19.801401 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5629edcd-0dfa-4de5-b590-1f5e6aec42cc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:19.801839 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5629edcd-0dfa-4de5-b590-1f5e6aec42cc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:19.862145 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-5629edcd-0dfa-4de5-b590-1f5e6aec42cc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:19.870272 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-5629edcd-0dfa-4de5-b590-1f5e6aec42cc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081412 Jun 22 09:26:19.870837 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 808/1570] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:19 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:20.887082 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-e2bbccd8-8762-4d2f-834b-25cfe3f8c06c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:20.887678 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-e2bbccd8-8762-4d2f-834b-25cfe3f8c06c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:20.894364 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e2bbccd8-8762-4d2f-834b-25cfe3f8c06c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:20.894808 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e2bbccd8-8762-4d2f-834b-25cfe3f8c06c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:20.895558 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e2bbccd8-8762-4d2f-834b-25cfe3f8c06c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:20.895993 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e2bbccd8-8762-4d2f-834b-25cfe3f8c06c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:20.958948 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-e2bbccd8-8762-4d2f-834b-25cfe3f8c06c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:20.967112 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-e2bbccd8-8762-4d2f-834b-25cfe3f8c06c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083861 Jun 22 09:26:20.967679 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 763/1571] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:20 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:21.985264 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-17e6a0b1-2af0-4384-bcaa-63d55d99297f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:21.985882 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-17e6a0b1-2af0-4384-bcaa-63d55d99297f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:21.992338 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-17e6a0b1-2af0-4384-bcaa-63d55d99297f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:21.992800 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-17e6a0b1-2af0-4384-bcaa-63d55d99297f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:21.993562 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-17e6a0b1-2af0-4384-bcaa-63d55d99297f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:21.993994 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-17e6a0b1-2af0-4384-bcaa-63d55d99297f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:22.055765 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-17e6a0b1-2af0-4384-bcaa-63d55d99297f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:22.063814 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-17e6a0b1-2af0-4384-bcaa-63d55d99297f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082346 Jun 22 09:26:22.064387 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 809/1572] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:21 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:23.081510 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a99ad4f2-a936-459e-95e3-647ff5f503cd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:23.082147 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a99ad4f2-a936-459e-95e3-647ff5f503cd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:23.088596 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a99ad4f2-a936-459e-95e3-647ff5f503cd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:23.089076 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a99ad4f2-a936-459e-95e3-647ff5f503cd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:23.089839 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a99ad4f2-a936-459e-95e3-647ff5f503cd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:23.090277 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a99ad4f2-a936-459e-95e3-647ff5f503cd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:23.152450 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-a99ad4f2-a936-459e-95e3-647ff5f503cd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:23.160945 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a99ad4f2-a936-459e-95e3-647ff5f503cd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083320 Jun 22 09:26:23.161502 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 764/1573] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:23 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:24.178119 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2389c142-5bc9-47a8-9884-95676e8e74cf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:24.178735 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2389c142-5bc9-47a8-9884-95676e8e74cf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:24.185273 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2389c142-5bc9-47a8-9884-95676e8e74cf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:24.185771 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2389c142-5bc9-47a8-9884-95676e8e74cf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:24.186551 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2389c142-5bc9-47a8-9884-95676e8e74cf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:24.186993 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2389c142-5bc9-47a8-9884-95676e8e74cf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:24.248342 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-2389c142-5bc9-47a8-9884-95676e8e74cf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:24.256318 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2389c142-5bc9-47a8-9884-95676e8e74cf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082405 Jun 22 09:26:24.256923 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 810/1574] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:24 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:25.275100 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ad1e54a7-2310-42fc-9dda-57529d63c1c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:25.275715 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ad1e54a7-2310-42fc-9dda-57529d63c1c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:25.282149 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ad1e54a7-2310-42fc-9dda-57529d63c1c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:25.282590 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ad1e54a7-2310-42fc-9dda-57529d63c1c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:25.283344 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ad1e54a7-2310-42fc-9dda-57529d63c1c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:25.283769 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ad1e54a7-2310-42fc-9dda-57529d63c1c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:25.298327 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:25.347453 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ad1e54a7-2310-42fc-9dda-57529d63c1c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:25.355354 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ad1e54a7-2310-42fc-9dda-57529d63c1c8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084112 Jun 22 09:26:25.355916 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 765/1575] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:25 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:26.372599 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-54e7c08c-6178-4935-bd61-e82d4cc184af tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:26.373272 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-54e7c08c-6178-4935-bd61-e82d4cc184af tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:26.380554 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-54e7c08c-6178-4935-bd61-e82d4cc184af tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:26.381030 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-54e7c08c-6178-4935-bd61-e82d4cc184af tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:26.381802 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-54e7c08c-6178-4935-bd61-e82d4cc184af tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:26.382244 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-54e7c08c-6178-4935-bd61-e82d4cc184af tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:26.442550 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-54e7c08c-6178-4935-bd61-e82d4cc184af tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:26.450441 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-54e7c08c-6178-4935-bd61-e82d4cc184af tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082081 Jun 22 09:26:26.450998 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 811/1576] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:26 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:27.466905 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-de26f61f-e398-4f25-bf5c-bdfd412b3d7f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:27.467517 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-de26f61f-e398-4f25-bf5c-bdfd412b3d7f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:27.475135 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-de26f61f-e398-4f25-bf5c-bdfd412b3d7f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:27.475585 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-de26f61f-e398-4f25-bf5c-bdfd412b3d7f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:27.476352 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-de26f61f-e398-4f25-bf5c-bdfd412b3d7f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:27.476808 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-de26f61f-e398-4f25-bf5c-bdfd412b3d7f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:27.538284 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-de26f61f-e398-4f25-bf5c-bdfd412b3d7f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:27.546144 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-de26f61f-e398-4f25-bf5c-bdfd412b3d7f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083150 Jun 22 09:26:27.546711 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 766/1577] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:27 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:28.562180 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d36ceacf-8af5-4d78-b931-2f752936ef31 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:28.562798 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-d36ceacf-8af5-4d78-b931-2f752936ef31 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:28.569540 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d36ceacf-8af5-4d78-b931-2f752936ef31 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:28.569986 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d36ceacf-8af5-4d78-b931-2f752936ef31 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:28.570736 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d36ceacf-8af5-4d78-b931-2f752936ef31 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:28.571170 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d36ceacf-8af5-4d78-b931-2f752936ef31 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:28.630955 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-d36ceacf-8af5-4d78-b931-2f752936ef31 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:28.638969 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d36ceacf-8af5-4d78-b931-2f752936ef31 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.080608 Jun 22 09:26:28.639525 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 812/1578] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:28 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:29.656807 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-09f084bd-051f-4101-979b-b31175210d59 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:29.657430 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-09f084bd-051f-4101-979b-b31175210d59 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:29.664581 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-09f084bd-051f-4101-979b-b31175210d59 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:29.665072 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-09f084bd-051f-4101-979b-b31175210d59 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:29.665843 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-09f084bd-051f-4101-979b-b31175210d59 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:29.666286 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-09f084bd-051f-4101-979b-b31175210d59 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:29.728753 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-09f084bd-051f-4101-979b-b31175210d59 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:29.736807 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-09f084bd-051f-4101-979b-b31175210d59 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083924 Jun 22 09:26:29.738021 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 767/1579] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:29 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:30.755662 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-eaf1e043-3639-4bd3-8f89-3ff58b86ee77 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:30.756308 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-eaf1e043-3639-4bd3-8f89-3ff58b86ee77 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:30.758886 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:30.763698 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eaf1e043-3639-4bd3-8f89-3ff58b86ee77 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:30.764184 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eaf1e043-3639-4bd3-8f89-3ff58b86ee77 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:30.764983 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eaf1e043-3639-4bd3-8f89-3ff58b86ee77 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:30.765429 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eaf1e043-3639-4bd3-8f89-3ff58b86ee77 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:30.826662 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-eaf1e043-3639-4bd3-8f89-3ff58b86ee77 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:30.835317 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-eaf1e043-3639-4bd3-8f89-3ff58b86ee77 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083592 Jun 22 09:26:30.835886 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 813/1580] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:30 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:31.852398 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-26211881-c5cb-448b-84ad-c49f43729f3f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:31.853111 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-26211881-c5cb-448b-84ad-c49f43729f3f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:31.859911 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-26211881-c5cb-448b-84ad-c49f43729f3f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:31.860361 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-26211881-c5cb-448b-84ad-c49f43729f3f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:31.861161 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-26211881-c5cb-448b-84ad-c49f43729f3f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:31.861604 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-26211881-c5cb-448b-84ad-c49f43729f3f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:31.923136 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-26211881-c5cb-448b-84ad-c49f43729f3f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:31.931005 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-26211881-c5cb-448b-84ad-c49f43729f3f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082584 Jun 22 09:26:31.931563 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 768/1581] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:31 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:32.948727 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-41511d6a-9154-4873-9d77-6ff97f20bb40 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:32.949342 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-41511d6a-9154-4873-9d77-6ff97f20bb40 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:32.956033 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-41511d6a-9154-4873-9d77-6ff97f20bb40 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:32.956480 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-41511d6a-9154-4873-9d77-6ff97f20bb40 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:32.957272 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-41511d6a-9154-4873-9d77-6ff97f20bb40 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:32.957709 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-41511d6a-9154-4873-9d77-6ff97f20bb40 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:32.961582 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=92 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:33.020217 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-41511d6a-9154-4873-9d77-6ff97f20bb40 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:33.028420 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-41511d6a-9154-4873-9d77-6ff97f20bb40 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083911 Jun 22 09:26:33.029009 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 814/1582] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:32 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:34.045395 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-211f5aea-8f39-460d-91d3-7521b24d9fbb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:34.045996 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-211f5aea-8f39-460d-91d3-7521b24d9fbb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:34.048316 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=34 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:34.053859 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-211f5aea-8f39-460d-91d3-7521b24d9fbb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:34.054312 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-211f5aea-8f39-460d-91d3-7521b24d9fbb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:34.055084 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-211f5aea-8f39-460d-91d3-7521b24d9fbb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:34.055530 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-211f5aea-8f39-460d-91d3-7521b24d9fbb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:34.118891 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-211f5aea-8f39-460d-91d3-7521b24d9fbb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:34.127040 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-211f5aea-8f39-460d-91d3-7521b24d9fbb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.085540 Jun 22 09:26:34.127598 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 769/1583] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:34 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:35.144696 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-25e38903-3436-461a-bdd4-d297941f3b2d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:35.145341 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-25e38903-3436-461a-bdd4-d297941f3b2d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:35.151973 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-25e38903-3436-461a-bdd4-d297941f3b2d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:35.152414 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-25e38903-3436-461a-bdd4-d297941f3b2d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:35.153208 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-25e38903-3436-461a-bdd4-d297941f3b2d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:35.153643 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-25e38903-3436-461a-bdd4-d297941f3b2d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:35.216174 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-25e38903-3436-461a-bdd4-d297941f3b2d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:35.225019 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-25e38903-3436-461a-bdd4-d297941f3b2d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084778 Jun 22 09:26:35.225586 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 815/1584] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:35 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:36.242493 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f93dfa3d-1177-46ec-80d9-4a19978859e8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:36.243108 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f93dfa3d-1177-46ec-80d9-4a19978859e8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:36.249906 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f93dfa3d-1177-46ec-80d9-4a19978859e8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:36.250357 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f93dfa3d-1177-46ec-80d9-4a19978859e8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:36.251114 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f93dfa3d-1177-46ec-80d9-4a19978859e8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:36.251551 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f93dfa3d-1177-46ec-80d9-4a19978859e8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:36.314971 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-f93dfa3d-1177-46ec-80d9-4a19978859e8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:36.322819 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f93dfa3d-1177-46ec-80d9-4a19978859e8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084294 Jun 22 09:26:36.323376 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 770/1585] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:36 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:37.123107 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:26:37.123372 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Wed Jun 22 09:26:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:26:37.339323 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-175ca7ec-0ba3-4651-955d-1fe60616830c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:37.339934 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-175ca7ec-0ba3-4651-955d-1fe60616830c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:37.346822 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-175ca7ec-0ba3-4651-955d-1fe60616830c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:37.347274 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-175ca7ec-0ba3-4651-955d-1fe60616830c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:37.348036 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-175ca7ec-0ba3-4651-955d-1fe60616830c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:37.348475 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-175ca7ec-0ba3-4651-955d-1fe60616830c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:37.409672 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-175ca7ec-0ba3-4651-955d-1fe60616830c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:37.417765 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-175ca7ec-0ba3-4651-955d-1fe60616830c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082278 Jun 22 09:26:37.418320 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 816/1586] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:37 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:38.134790 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [req-7cac7ea9-7333-4be1-b442-5d39741c1170 req-d9fc71e3-c96c-4fba-9144-9dcae03587b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb580ec8-80e7-4908-8761-08e8b136be42", "name": "network-vif-deleted", "tag": "9ad2e9b8-6709-4bf7-b051-613d55daa2f8"}]} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:26:38.144094 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-7cac7ea9-7333-4be1-b442-5d39741c1170 req-d9fc71e3-c96c-4fba-9144-9dcae03587b8 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:38.144829 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-7cac7ea9-7333-4be1-b442-5d39741c1170 req-d9fc71e3-c96c-4fba-9144-9dcae03587b8 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:38.155509 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.compute.server_external_events [req-7cac7ea9-7333-4be1-b442-5d39741c1170 req-d9fc71e3-c96c-4fba-9144-9dcae03587b8 service nova] Creating event network-vif-deleted:9ad2e9b8-6709-4bf7-b051-613d55daa2f8 for instance fb580ec8-80e7-4908-8761-08e8b136be42 on hv-cinder-84599 Jun 22 09:26:38.160626 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [req-7cac7ea9-7333-4be1-b442-5d39741c1170 req-d9fc71e3-c96c-4fba-9144-9dcae03587b8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029470 Jun 22 09:26:38.161241 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 771/1587] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:26:38.435717 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-bceaa5dd-da7d-4598-a818-5f6d1a374e8a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:38.436332 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-bceaa5dd-da7d-4598-a818-5f6d1a374e8a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:38.443907 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bceaa5dd-da7d-4598-a818-5f6d1a374e8a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:38.444365 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bceaa5dd-da7d-4598-a818-5f6d1a374e8a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:38.445156 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bceaa5dd-da7d-4598-a818-5f6d1a374e8a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:38.445604 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bceaa5dd-da7d-4598-a818-5f6d1a374e8a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:38.509644 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-bceaa5dd-da7d-4598-a818-5f6d1a374e8a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:38.517878 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-bceaa5dd-da7d-4598-a818-5f6d1a374e8a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.086333 Jun 22 09:26:38.518914 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 817/1588] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:38 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:39.536255 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-166ab7b9-8e08-45ec-9345-62b7702f629e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:39.536988 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-166ab7b9-8e08-45ec-9345-62b7702f629e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:39.543200 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-166ab7b9-8e08-45ec-9345-62b7702f629e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:39.543651 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-166ab7b9-8e08-45ec-9345-62b7702f629e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:39.544412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-166ab7b9-8e08-45ec-9345-62b7702f629e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:39.544887 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-166ab7b9-8e08-45ec-9345-62b7702f629e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:39.606292 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-166ab7b9-8e08-45ec-9345-62b7702f629e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:39.614135 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-166ab7b9-8e08-45ec-9345-62b7702f629e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082769 Jun 22 09:26:39.614692 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 772/1589] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:39 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:40.631159 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-42f11605-90ef-421c-8ee4-29a561ffb543 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:40.631770 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-42f11605-90ef-421c-8ee4-29a561ffb543 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:40.638458 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-42f11605-90ef-421c-8ee4-29a561ffb543 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:40.638898 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-42f11605-90ef-421c-8ee4-29a561ffb543 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:40.639725 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-42f11605-90ef-421c-8ee4-29a561ffb543 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:40.640178 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-42f11605-90ef-421c-8ee4-29a561ffb543 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:40.702405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-42f11605-90ef-421c-8ee4-29a561ffb543 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:40.710836 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-42f11605-90ef-421c-8ee4-29a561ffb543 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083980 Jun 22 09:26:40.711391 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 818/1590] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:40 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:41.727954 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-0a4bd7c9-d19a-4c4e-a0a8-fc5917408b75 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:41.728628 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-0a4bd7c9-d19a-4c4e-a0a8-fc5917408b75 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:41.735193 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0a4bd7c9-d19a-4c4e-a0a8-fc5917408b75 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:41.735650 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0a4bd7c9-d19a-4c4e-a0a8-fc5917408b75 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:41.737029 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0a4bd7c9-d19a-4c4e-a0a8-fc5917408b75 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:41.737487 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0a4bd7c9-d19a-4c4e-a0a8-fc5917408b75 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:41.797365 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-0a4bd7c9-d19a-4c4e-a0a8-fc5917408b75 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:41.805946 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-0a4bd7c9-d19a-4c4e-a0a8-fc5917408b75 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081918 Jun 22 09:26:41.806512 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 773/1591] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:41 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:42.822817 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f71c659f-358e-41dc-be74-5f9ca306ff59 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:42.823466 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-f71c659f-358e-41dc-be74-5f9ca306ff59 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:42.829957 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f71c659f-358e-41dc-be74-5f9ca306ff59 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:42.830819 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f71c659f-358e-41dc-be74-5f9ca306ff59 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:42.832019 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f71c659f-358e-41dc-be74-5f9ca306ff59 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:42.832460 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f71c659f-358e-41dc-be74-5f9ca306ff59 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:42.897856 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-f71c659f-358e-41dc-be74-5f9ca306ff59 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:42.905871 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f71c659f-358e-41dc-be74-5f9ca306ff59 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.086967 Jun 22 09:26:42.906427 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 819/1592] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:42 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:43.922852 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-5fe6a009-744e-4c06-aaa9-3ffffe37252a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:43.923422 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-5fe6a009-744e-4c06-aaa9-3ffffe37252a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:43.930652 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5fe6a009-744e-4c06-aaa9-3ffffe37252a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:43.931097 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5fe6a009-744e-4c06-aaa9-3ffffe37252a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:43.931849 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5fe6a009-744e-4c06-aaa9-3ffffe37252a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:43.932282 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5fe6a009-744e-4c06-aaa9-3ffffe37252a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:43.992746 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-5fe6a009-744e-4c06-aaa9-3ffffe37252a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:44.001274 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-5fe6a009-744e-4c06-aaa9-3ffffe37252a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082299 Jun 22 09:26:44.001847 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 774/1593] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:43 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:45.019659 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-ebb021c4-f804-46a7-966f-2c79654f8e6e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:45.020260 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-ebb021c4-f804-46a7-966f-2c79654f8e6e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:45.026710 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ebb021c4-f804-46a7-966f-2c79654f8e6e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:45.027156 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ebb021c4-f804-46a7-966f-2c79654f8e6e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:45.027906 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ebb021c4-f804-46a7-966f-2c79654f8e6e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:45.028343 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ebb021c4-f804-46a7-966f-2c79654f8e6e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:45.088504 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-ebb021c4-f804-46a7-966f-2c79654f8e6e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:45.097417 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-ebb021c4-f804-46a7-966f-2c79654f8e6e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082195 Jun 22 09:26:45.098014 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 820/1594] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:45 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:46.114228 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-836c5998-8b95-4535-96dd-091e39fe1b55 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:46.114838 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-836c5998-8b95-4535-96dd-091e39fe1b55 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:46.121585 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-836c5998-8b95-4535-96dd-091e39fe1b55 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:46.122030 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-836c5998-8b95-4535-96dd-091e39fe1b55 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:46.122783 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-836c5998-8b95-4535-96dd-091e39fe1b55 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:46.123215 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-836c5998-8b95-4535-96dd-091e39fe1b55 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:46.183751 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-836c5998-8b95-4535-96dd-091e39fe1b55 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:46.192458 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-836c5998-8b95-4535-96dd-091e39fe1b55 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082107 Jun 22 09:26:46.193097 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 775/1595] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:46 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:47.209399 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-6ea87230-0d76-43f7-a203-a134fddb3e37 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:47.210013 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-6ea87230-0d76-43f7-a203-a134fddb3e37 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:47.216512 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6ea87230-0d76-43f7-a203-a134fddb3e37 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:47.216998 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6ea87230-0d76-43f7-a203-a134fddb3e37 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:47.217755 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6ea87230-0d76-43f7-a203-a134fddb3e37 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:47.218188 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6ea87230-0d76-43f7-a203-a134fddb3e37 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:47.280808 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-6ea87230-0d76-43f7-a203-a134fddb3e37 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:47.290106 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-6ea87230-0d76-43f7-a203-a134fddb3e37 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084639 Jun 22 09:26:47.290660 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 821/1596] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:47 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:48.307593 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-9dd99101-c828-438e-95c7-6d6c03b6fdc7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:48.308210 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-9dd99101-c828-438e-95c7-6d6c03b6fdc7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:48.314993 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9dd99101-c828-438e-95c7-6d6c03b6fdc7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:48.315449 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9dd99101-c828-438e-95c7-6d6c03b6fdc7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:48.316215 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9dd99101-c828-438e-95c7-6d6c03b6fdc7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:48.316654 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9dd99101-c828-438e-95c7-6d6c03b6fdc7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:48.377425 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-9dd99101-c828-438e-95c7-6d6c03b6fdc7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:48.385298 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-9dd99101-c828-438e-95c7-6d6c03b6fdc7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081638 Jun 22 09:26:48.385862 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 776/1597] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:48 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:49.402162 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-83937125-4a09-4a2e-95f1-c860a6a77cef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:49.402772 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-83937125-4a09-4a2e-95f1-c860a6a77cef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:49.409360 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-83937125-4a09-4a2e-95f1-c860a6a77cef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:49.409865 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-83937125-4a09-4a2e-95f1-c860a6a77cef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:49.410558 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-83937125-4a09-4a2e-95f1-c860a6a77cef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:49.410992 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-83937125-4a09-4a2e-95f1-c860a6a77cef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:49.474247 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-83937125-4a09-4a2e-95f1-c860a6a77cef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:49.482366 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-83937125-4a09-4a2e-95f1-c860a6a77cef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084058 Jun 22 09:26:49.482926 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 822/1598] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:49 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:50.499684 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-59d11b10-18b9-46bf-be6f-1938ae2a342b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:50.500237 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-59d11b10-18b9-46bf-be6f-1938ae2a342b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:50.507182 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-59d11b10-18b9-46bf-be6f-1938ae2a342b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:50.507635 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-59d11b10-18b9-46bf-be6f-1938ae2a342b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:50.508400 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-59d11b10-18b9-46bf-be6f-1938ae2a342b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:50.508860 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-59d11b10-18b9-46bf-be6f-1938ae2a342b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:50.571199 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-59d11b10-18b9-46bf-be6f-1938ae2a342b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:50.579031 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-59d11b10-18b9-46bf-be6f-1938ae2a342b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083309 Jun 22 09:26:50.579632 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 777/1599] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:50 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:51.597125 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-74726eb3-510d-49aa-8e5d-66903c077715 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:51.597745 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-74726eb3-510d-49aa-8e5d-66903c077715 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:51.604234 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-74726eb3-510d-49aa-8e5d-66903c077715 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:51.604689 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-74726eb3-510d-49aa-8e5d-66903c077715 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:51.605484 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-74726eb3-510d-49aa-8e5d-66903c077715 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:51.605924 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-74726eb3-510d-49aa-8e5d-66903c077715 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:51.668374 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-74726eb3-510d-49aa-8e5d-66903c077715 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:51.677571 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-74726eb3-510d-49aa-8e5d-66903c077715 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084912 Jun 22 09:26:51.678133 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 823/1600] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:51 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:52.695241 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ce1ecffd-c101-4006-9e20-8ef7cb374210 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:52.695837 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ce1ecffd-c101-4006-9e20-8ef7cb374210 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:52.702382 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ce1ecffd-c101-4006-9e20-8ef7cb374210 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:52.714061 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ce1ecffd-c101-4006-9e20-8ef7cb374210 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:52.714061 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ce1ecffd-c101-4006-9e20-8ef7cb374210 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:52.714061 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ce1ecffd-c101-4006-9e20-8ef7cb374210 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:52.765152 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ce1ecffd-c101-4006-9e20-8ef7cb374210 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:52.774029 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ce1ecffd-c101-4006-9e20-8ef7cb374210 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082548 Jun 22 09:26:52.774595 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 778/1601] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:52 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:53.791394 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e58bf1a4-8870-48f7-96a7-70978aa7ccbd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:53.792003 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e58bf1a4-8870-48f7-96a7-70978aa7ccbd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:53.799242 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e58bf1a4-8870-48f7-96a7-70978aa7ccbd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:53.799697 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e58bf1a4-8870-48f7-96a7-70978aa7ccbd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:53.800439 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e58bf1a4-8870-48f7-96a7-70978aa7ccbd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:53.800896 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e58bf1a4-8870-48f7-96a7-70978aa7ccbd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:53.860134 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-e58bf1a4-8870-48f7-96a7-70978aa7ccbd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:53.869125 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e58bf1a4-8870-48f7-96a7-70978aa7ccbd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081609 Jun 22 09:26:53.869688 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 824/1602] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:53 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:54.886558 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-64e0fe97-17c3-4f5a-be09-8f2963e673b2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:54.887148 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-64e0fe97-17c3-4f5a-be09-8f2963e673b2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:54.893894 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-64e0fe97-17c3-4f5a-be09-8f2963e673b2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:54.894334 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-64e0fe97-17c3-4f5a-be09-8f2963e673b2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:54.895088 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-64e0fe97-17c3-4f5a-be09-8f2963e673b2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:54.895517 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-64e0fe97-17c3-4f5a-be09-8f2963e673b2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:54.956559 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-64e0fe97-17c3-4f5a-be09-8f2963e673b2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:54.964630 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-64e0fe97-17c3-4f5a-be09-8f2963e673b2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081998 Jun 22 09:26:54.965217 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 779/1603] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:54 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:55.981859 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-10d366db-bf4b-4b50-a197-21fab7748776 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:55.982479 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-10d366db-bf4b-4b50-a197-21fab7748776 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:55.990021 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-10d366db-bf4b-4b50-a197-21fab7748776 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:55.990470 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-10d366db-bf4b-4b50-a197-21fab7748776 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:55.991236 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-10d366db-bf4b-4b50-a197-21fab7748776 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:55.991675 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-10d366db-bf4b-4b50-a197-21fab7748776 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:56.055629 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-10d366db-bf4b-4b50-a197-21fab7748776 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:56.063486 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-10d366db-bf4b-4b50-a197-21fab7748776 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.085561 Jun 22 09:26:56.064306 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 825/1604] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:55 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:57.081857 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c0a4cc24-28f9-4bfb-aaa8-c3c652a9cb8c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:57.082529 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c0a4cc24-28f9-4bfb-aaa8-c3c652a9cb8c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:57.089116 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c0a4cc24-28f9-4bfb-aaa8-c3c652a9cb8c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:57.089558 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c0a4cc24-28f9-4bfb-aaa8-c3c652a9cb8c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:57.090326 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c0a4cc24-28f9-4bfb-aaa8-c3c652a9cb8c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:57.090769 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c0a4cc24-28f9-4bfb-aaa8-c3c652a9cb8c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:57.153171 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-c0a4cc24-28f9-4bfb-aaa8-c3c652a9cb8c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:57.162699 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c0a4cc24-28f9-4bfb-aaa8-c3c652a9cb8c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.085493 Jun 22 09:26:57.163281 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 780/1605] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:57 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:58.179588 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-ad005cfd-5516-418d-add8-d47aed7bbb2a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:58.180204 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-ad005cfd-5516-418d-add8-d47aed7bbb2a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:58.186717 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ad005cfd-5516-418d-add8-d47aed7bbb2a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:58.187168 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ad005cfd-5516-418d-add8-d47aed7bbb2a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:58.187926 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ad005cfd-5516-418d-add8-d47aed7bbb2a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:58.188363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ad005cfd-5516-418d-add8-d47aed7bbb2a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:58.250347 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-ad005cfd-5516-418d-add8-d47aed7bbb2a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:58.258867 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-ad005cfd-5516-418d-add8-d47aed7bbb2a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083129 Jun 22 09:26:58.259426 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 826/1606] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:58 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:26:59.276583 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-98f15bd3-4a5e-4c5f-bf34-55f5a297b8d5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:26:59.277232 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-98f15bd3-4a5e-4c5f-bf34-55f5a297b8d5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:26:59.284715 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-98f15bd3-4a5e-4c5f-bf34-55f5a297b8d5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:59.285206 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-98f15bd3-4a5e-4c5f-bf34-55f5a297b8d5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:59.285962 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-98f15bd3-4a5e-4c5f-bf34-55f5a297b8d5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:26:59.286397 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-98f15bd3-4a5e-4c5f-bf34-55f5a297b8d5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:26:59.289047 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=90 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:59.348012 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-98f15bd3-4a5e-4c5f-bf34-55f5a297b8d5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:26:59.356491 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-98f15bd3-4a5e-4c5f-bf34-55f5a297b8d5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083658 Jun 22 09:26:59.356985 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 781/1607] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:26:59 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:00.374178 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-88548833-c840-4c52-a971-e7a6b2ce1877 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:00.374840 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-88548833-c840-4c52-a971-e7a6b2ce1877 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:00.381608 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-88548833-c840-4c52-a971-e7a6b2ce1877 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:00.382069 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-88548833-c840-4c52-a971-e7a6b2ce1877 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:00.382845 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-88548833-c840-4c52-a971-e7a6b2ce1877 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:00.383289 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-88548833-c840-4c52-a971-e7a6b2ce1877 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:00.447177 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-88548833-c840-4c52-a971-e7a6b2ce1877 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:00.455377 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-88548833-c840-4c52-a971-e7a6b2ce1877 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.085106 Jun 22 09:27:00.455932 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 827/1608] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:00 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:01.472029 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-e3c8f975-26b5-4b75-8b1a-bc93e4db1ff1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:01.472606 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-e3c8f975-26b5-4b75-8b1a-bc93e4db1ff1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:01.479256 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e3c8f975-26b5-4b75-8b1a-bc93e4db1ff1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:01.479714 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e3c8f975-26b5-4b75-8b1a-bc93e4db1ff1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:01.480480 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e3c8f975-26b5-4b75-8b1a-bc93e4db1ff1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:01.480958 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e3c8f975-26b5-4b75-8b1a-bc93e4db1ff1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:01.541468 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-e3c8f975-26b5-4b75-8b1a-bc93e4db1ff1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:01.549529 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-e3c8f975-26b5-4b75-8b1a-bc93e4db1ff1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081969 Jun 22 09:27:01.550095 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 782/1609] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:01 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:02.566208 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2254625e-6751-4f21-8da9-f724b5047960 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:02.566818 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2254625e-6751-4f21-8da9-f724b5047960 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:02.573267 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2254625e-6751-4f21-8da9-f724b5047960 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:02.573710 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2254625e-6751-4f21-8da9-f724b5047960 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:02.574462 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2254625e-6751-4f21-8da9-f724b5047960 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:02.574898 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2254625e-6751-4f21-8da9-f724b5047960 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:02.636968 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-2254625e-6751-4f21-8da9-f724b5047960 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:02.645475 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2254625e-6751-4f21-8da9-f724b5047960 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083728 Jun 22 09:27:02.646027 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 828/1610] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:02 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:03.662457 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ab90f327-9553-4248-9688-6459d43cf1c3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:03.663081 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ab90f327-9553-4248-9688-6459d43cf1c3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:03.669763 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ab90f327-9553-4248-9688-6459d43cf1c3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:03.670216 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ab90f327-9553-4248-9688-6459d43cf1c3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:03.670990 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ab90f327-9553-4248-9688-6459d43cf1c3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:03.671433 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ab90f327-9553-4248-9688-6459d43cf1c3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:03.734021 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ab90f327-9553-4248-9688-6459d43cf1c3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:03.742814 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ab90f327-9553-4248-9688-6459d43cf1c3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084200 Jun 22 09:27:03.743372 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 783/1611] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:03 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:04.760088 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-510b9152-efdc-4ff0-b043-f1f98d9adc02 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:04.760710 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-510b9152-efdc-4ff0-b043-f1f98d9adc02 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:04.763514 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=32 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:27:04.768262 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-510b9152-efdc-4ff0-b043-f1f98d9adc02 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:04.769399 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-510b9152-efdc-4ff0-b043-f1f98d9adc02 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:04.770173 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-510b9152-efdc-4ff0-b043-f1f98d9adc02 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:04.770619 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-510b9152-efdc-4ff0-b043-f1f98d9adc02 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:04.835331 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-510b9152-efdc-4ff0-b043-f1f98d9adc02 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:04.843405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-510b9152-efdc-4ff0-b043-f1f98d9adc02 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.087168 Jun 22 09:27:04.843969 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 829/1612] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:04 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:05.859350 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ea05e56f-db80-4743-b6e0-9ce8791a74d4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:05.859967 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ea05e56f-db80-4743-b6e0-9ce8791a74d4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:05.862895 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=30 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:27:05.868386 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ea05e56f-db80-4743-b6e0-9ce8791a74d4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:05.868863 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ea05e56f-db80-4743-b6e0-9ce8791a74d4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:05.869636 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ea05e56f-db80-4743-b6e0-9ce8791a74d4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:05.870077 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ea05e56f-db80-4743-b6e0-9ce8791a74d4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:05.931234 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ea05e56f-db80-4743-b6e0-9ce8791a74d4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:05.939174 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ea05e56f-db80-4743-b6e0-9ce8791a74d4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083763 Jun 22 09:27:05.939747 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 784/1613] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:05 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:06.956459 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2592f166-988c-447a-a8dd-d49b91fb39dc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:06.957587 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2592f166-988c-447a-a8dd-d49b91fb39dc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:06.964072 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2592f166-988c-447a-a8dd-d49b91fb39dc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:06.964519 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2592f166-988c-447a-a8dd-d49b91fb39dc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:06.965318 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2592f166-988c-447a-a8dd-d49b91fb39dc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:06.965753 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2592f166-988c-447a-a8dd-d49b91fb39dc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:06.969667 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=96 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:27:07.031062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-2592f166-988c-447a-a8dd-d49b91fb39dc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:07.039830 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2592f166-988c-447a-a8dd-d49b91fb39dc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.087206 Jun 22 09:27:07.040402 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 830/1614] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:06 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:08.058482 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-620978a0-9975-418c-8372-1aeb617b2c47 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:08.059082 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-620978a0-9975-418c-8372-1aeb617b2c47 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:08.065575 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-620978a0-9975-418c-8372-1aeb617b2c47 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:08.066032 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-620978a0-9975-418c-8372-1aeb617b2c47 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:08.066794 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-620978a0-9975-418c-8372-1aeb617b2c47 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:08.067886 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-620978a0-9975-418c-8372-1aeb617b2c47 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:08.128845 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-620978a0-9975-418c-8372-1aeb617b2c47 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:08.136960 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-620978a0-9975-418c-8372-1aeb617b2c47 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082409 Jun 22 09:27:08.137519 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 785/1615] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:08 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:09.153842 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e846746f-83da-4d15-8858-368182f36e2b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:09.154464 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e846746f-83da-4d15-8858-368182f36e2b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:09.161084 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e846746f-83da-4d15-8858-368182f36e2b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:09.161537 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e846746f-83da-4d15-8858-368182f36e2b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:09.162305 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e846746f-83da-4d15-8858-368182f36e2b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:09.162742 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e846746f-83da-4d15-8858-368182f36e2b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:09.225874 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-e846746f-83da-4d15-8858-368182f36e2b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:09.233994 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e846746f-83da-4d15-8858-368182f36e2b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084047 Jun 22 09:27:09.234559 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 831/1616] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:09 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:10.251934 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-376072d7-f08a-40f9-8b62-8d4386286b9d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:10.252572 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-376072d7-f08a-40f9-8b62-8d4386286b9d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:10.258660 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-376072d7-f08a-40f9-8b62-8d4386286b9d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:10.259100 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-376072d7-f08a-40f9-8b62-8d4386286b9d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:10.259852 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-376072d7-f08a-40f9-8b62-8d4386286b9d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:10.260282 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-376072d7-f08a-40f9-8b62-8d4386286b9d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:10.320323 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-376072d7-f08a-40f9-8b62-8d4386286b9d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:10.328185 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-376072d7-f08a-40f9-8b62-8d4386286b9d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.080268 Jun 22 09:27:10.328738 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 786/1617] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:10 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:11.345814 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e0b49943-9348-4c8b-92e9-32f159bd3a0f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:11.346465 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e0b49943-9348-4c8b-92e9-32f159bd3a0f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:11.353732 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e0b49943-9348-4c8b-92e9-32f159bd3a0f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:11.354196 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e0b49943-9348-4c8b-92e9-32f159bd3a0f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:11.355023 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e0b49943-9348-4c8b-92e9-32f159bd3a0f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:11.355468 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e0b49943-9348-4c8b-92e9-32f159bd3a0f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:11.418475 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-e0b49943-9348-4c8b-92e9-32f159bd3a0f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:11.427275 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e0b49943-9348-4c8b-92e9-32f159bd3a0f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084786 Jun 22 09:27:11.427854 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 832/1618] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:11 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:12.444171 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6c59c596-01a6-42e5-8956-a3c730cd7780 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:12.444703 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-6c59c596-01a6-42e5-8956-a3c730cd7780 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:12.451214 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6c59c596-01a6-42e5-8956-a3c730cd7780 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:12.451656 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6c59c596-01a6-42e5-8956-a3c730cd7780 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:12.452404 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6c59c596-01a6-42e5-8956-a3c730cd7780 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:12.452858 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6c59c596-01a6-42e5-8956-a3c730cd7780 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:12.512676 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-6c59c596-01a6-42e5-8956-a3c730cd7780 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:12.520525 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-6c59c596-01a6-42e5-8956-a3c730cd7780 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081003 Jun 22 09:27:12.521193 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 787/1619] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:12 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:13.537647 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-56416c22-b82a-4eef-8a5d-8a31090d2dab tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:13.538297 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-56416c22-b82a-4eef-8a5d-8a31090d2dab tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:13.544792 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-56416c22-b82a-4eef-8a5d-8a31090d2dab tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:13.545253 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-56416c22-b82a-4eef-8a5d-8a31090d2dab tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:13.546013 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-56416c22-b82a-4eef-8a5d-8a31090d2dab tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:13.546452 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-56416c22-b82a-4eef-8a5d-8a31090d2dab tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:13.609394 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-56416c22-b82a-4eef-8a5d-8a31090d2dab tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:13.617548 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-56416c22-b82a-4eef-8a5d-8a31090d2dab tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083700 Jun 22 09:27:13.618105 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 833/1620] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:13 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:14.634800 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-5ed9d051-dc86-4d01-a50b-8cbf0bd3197a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:14.635410 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-5ed9d051-dc86-4d01-a50b-8cbf0bd3197a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:14.641953 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5ed9d051-dc86-4d01-a50b-8cbf0bd3197a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:14.642404 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5ed9d051-dc86-4d01-a50b-8cbf0bd3197a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:14.643164 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5ed9d051-dc86-4d01-a50b-8cbf0bd3197a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:14.643604 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5ed9d051-dc86-4d01-a50b-8cbf0bd3197a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:14.703568 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-5ed9d051-dc86-4d01-a50b-8cbf0bd3197a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:14.711967 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-5ed9d051-dc86-4d01-a50b-8cbf0bd3197a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081231 Jun 22 09:27:14.712533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 788/1621] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:14 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:15.729990 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-cee3934e-a2a3-4d11-9540-e39e248a3990 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:15.730640 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-cee3934e-a2a3-4d11-9540-e39e248a3990 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:15.737300 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cee3934e-a2a3-4d11-9540-e39e248a3990 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:15.737750 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cee3934e-a2a3-4d11-9540-e39e248a3990 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:15.738512 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cee3934e-a2a3-4d11-9540-e39e248a3990 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:15.738955 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-cee3934e-a2a3-4d11-9540-e39e248a3990 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:15.801524 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-cee3934e-a2a3-4d11-9540-e39e248a3990 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:15.810671 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-cee3934e-a2a3-4d11-9540-e39e248a3990 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084614 Jun 22 09:27:15.811235 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 834/1622] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:15 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:16.828032 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-44d9a46f-fdbe-4611-b05d-4589b3f33d7c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:16.828666 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-44d9a46f-fdbe-4611-b05d-4589b3f33d7c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:16.835477 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-44d9a46f-fdbe-4611-b05d-4589b3f33d7c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:16.835931 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-44d9a46f-fdbe-4611-b05d-4589b3f33d7c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:16.836692 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-44d9a46f-fdbe-4611-b05d-4589b3f33d7c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:16.837154 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-44d9a46f-fdbe-4611-b05d-4589b3f33d7c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:16.898042 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-44d9a46f-fdbe-4611-b05d-4589b3f33d7c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:16.906117 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-44d9a46f-fdbe-4611-b05d-4589b3f33d7c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082016 Jun 22 09:27:16.906669 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 789/1623] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:16 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:17.922158 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a48cc1db-eca9-4c46-813a-a9ab27e5134f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:17.922759 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-a48cc1db-eca9-4c46-813a-a9ab27e5134f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:17.930025 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a48cc1db-eca9-4c46-813a-a9ab27e5134f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:17.930468 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a48cc1db-eca9-4c46-813a-a9ab27e5134f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:17.931217 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a48cc1db-eca9-4c46-813a-a9ab27e5134f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:17.931648 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a48cc1db-eca9-4c46-813a-a9ab27e5134f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:17.995352 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-a48cc1db-eca9-4c46-813a-a9ab27e5134f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:18.003320 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a48cc1db-eca9-4c46-813a-a9ab27e5134f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.085023 Jun 22 09:27:18.003905 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 835/1624] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:17 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:19.020629 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a59be8c2-17ec-47ce-ac78-2eb0c98f7271 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:19.021272 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a59be8c2-17ec-47ce-ac78-2eb0c98f7271 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:19.027791 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a59be8c2-17ec-47ce-ac78-2eb0c98f7271 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:19.028240 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a59be8c2-17ec-47ce-ac78-2eb0c98f7271 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:19.029038 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a59be8c2-17ec-47ce-ac78-2eb0c98f7271 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:19.029481 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a59be8c2-17ec-47ce-ac78-2eb0c98f7271 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:19.090789 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-a59be8c2-17ec-47ce-ac78-2eb0c98f7271 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:19.098606 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a59be8c2-17ec-47ce-ac78-2eb0c98f7271 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082090 Jun 22 09:27:19.099162 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 790/1625] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:19 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:20.115578 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f7d51e89-4292-4de1-9b4e-0eb17f44bc9b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:20.116329 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-f7d51e89-4292-4de1-9b4e-0eb17f44bc9b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:20.122893 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f7d51e89-4292-4de1-9b4e-0eb17f44bc9b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:20.123337 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f7d51e89-4292-4de1-9b4e-0eb17f44bc9b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:20.124090 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f7d51e89-4292-4de1-9b4e-0eb17f44bc9b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:20.124521 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f7d51e89-4292-4de1-9b4e-0eb17f44bc9b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:20.186551 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-f7d51e89-4292-4de1-9b4e-0eb17f44bc9b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:20.194531 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f7d51e89-4292-4de1-9b4e-0eb17f44bc9b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083566 Jun 22 09:27:20.195089 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 836/1626] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:20 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:21.211985 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a17fd0c0-91e5-407f-92a3-83ff6737ef0a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:21.212580 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a17fd0c0-91e5-407f-92a3-83ff6737ef0a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:21.219167 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a17fd0c0-91e5-407f-92a3-83ff6737ef0a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:21.219621 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a17fd0c0-91e5-407f-92a3-83ff6737ef0a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:21.220385 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a17fd0c0-91e5-407f-92a3-83ff6737ef0a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:21.220842 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a17fd0c0-91e5-407f-92a3-83ff6737ef0a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:21.282799 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-a17fd0c0-91e5-407f-92a3-83ff6737ef0a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:21.291907 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a17fd0c0-91e5-407f-92a3-83ff6737ef0a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084373 Jun 22 09:27:21.292477 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 791/1627] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:21 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:22.308367 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-6a058cdd-525b-4cc6-92bb-38411ffa8892 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:22.309007 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-6a058cdd-525b-4cc6-92bb-38411ffa8892 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:22.315493 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6a058cdd-525b-4cc6-92bb-38411ffa8892 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:22.315947 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6a058cdd-525b-4cc6-92bb-38411ffa8892 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:22.316700 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6a058cdd-525b-4cc6-92bb-38411ffa8892 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:22.317161 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6a058cdd-525b-4cc6-92bb-38411ffa8892 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:22.382592 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-6a058cdd-525b-4cc6-92bb-38411ffa8892 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:22.391077 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-6a058cdd-525b-4cc6-92bb-38411ffa8892 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.086563 Jun 22 09:27:22.391655 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 837/1628] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:22 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:23.409010 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f1e6e966-1ed5-4e0e-a0ec-9f8ce55edf7f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:23.409656 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f1e6e966-1ed5-4e0e-a0ec-9f8ce55edf7f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:23.417085 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f1e6e966-1ed5-4e0e-a0ec-9f8ce55edf7f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:23.417538 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f1e6e966-1ed5-4e0e-a0ec-9f8ce55edf7f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:23.418302 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f1e6e966-1ed5-4e0e-a0ec-9f8ce55edf7f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:23.418742 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f1e6e966-1ed5-4e0e-a0ec-9f8ce55edf7f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:23.480415 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-f1e6e966-1ed5-4e0e-a0ec-9f8ce55edf7f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:23.488405 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f1e6e966-1ed5-4e0e-a0ec-9f8ce55edf7f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083336 Jun 22 09:27:23.489001 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 792/1629] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:23 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:24.506386 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-ca1a3f00-feea-4d41-94d1-5f191584c45d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:24.506927 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-ca1a3f00-feea-4d41-94d1-5f191584c45d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:24.513428 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ca1a3f00-feea-4d41-94d1-5f191584c45d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:24.513879 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ca1a3f00-feea-4d41-94d1-5f191584c45d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:24.514635 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ca1a3f00-feea-4d41-94d1-5f191584c45d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:24.515069 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ca1a3f00-feea-4d41-94d1-5f191584c45d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:24.575218 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-ca1a3f00-feea-4d41-94d1-5f191584c45d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:24.583297 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-ca1a3f00-feea-4d41-94d1-5f191584c45d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081623 Jun 22 09:27:24.584503 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 838/1630] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:24 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:25.601621 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a8d3edf3-7273-43ab-97c3-5b98651eb21a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:25.602263 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a8d3edf3-7273-43ab-97c3-5b98651eb21a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:25.608728 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a8d3edf3-7273-43ab-97c3-5b98651eb21a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:25.609255 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a8d3edf3-7273-43ab-97c3-5b98651eb21a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:25.610011 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a8d3edf3-7273-43ab-97c3-5b98651eb21a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:25.610452 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a8d3edf3-7273-43ab-97c3-5b98651eb21a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:25.672117 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-a8d3edf3-7273-43ab-97c3-5b98651eb21a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:25.680102 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a8d3edf3-7273-43ab-97c3-5b98651eb21a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083138 Jun 22 09:27:25.680658 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 793/1631] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:25 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:26.697199 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-4b4ebe34-1823-4e5e-98e3-5108fda5519f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:26.697818 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-4b4ebe34-1823-4e5e-98e3-5108fda5519f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:26.704370 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4b4ebe34-1823-4e5e-98e3-5108fda5519f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:26.704842 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4b4ebe34-1823-4e5e-98e3-5108fda5519f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:26.705597 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4b4ebe34-1823-4e5e-98e3-5108fda5519f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:26.706029 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4b4ebe34-1823-4e5e-98e3-5108fda5519f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:26.768313 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-4b4ebe34-1823-4e5e-98e3-5108fda5519f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:26.776227 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-4b4ebe34-1823-4e5e-98e3-5108fda5519f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083723 Jun 22 09:27:26.776798 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 839/1632] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:26 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:27.792862 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-e5dda856-816c-49ad-96a7-2b75865fb009 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:27.793481 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-e5dda856-816c-49ad-96a7-2b75865fb009 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:27.800108 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e5dda856-816c-49ad-96a7-2b75865fb009 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:27.800558 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e5dda856-816c-49ad-96a7-2b75865fb009 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:27.801343 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e5dda856-816c-49ad-96a7-2b75865fb009 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:27.801782 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e5dda856-816c-49ad-96a7-2b75865fb009 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:27.864062 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-e5dda856-816c-49ad-96a7-2b75865fb009 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:27.872274 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-e5dda856-816c-49ad-96a7-2b75865fb009 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083402 Jun 22 09:27:27.872853 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 794/1633] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:27 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:28.889587 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-fb45265a-04c2-48e3-a6e2-dc2a61e0fea7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:28.890208 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-fb45265a-04c2-48e3-a6e2-dc2a61e0fea7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:28.897293 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fb45265a-04c2-48e3-a6e2-dc2a61e0fea7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:28.897744 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fb45265a-04c2-48e3-a6e2-dc2a61e0fea7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:28.898509 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fb45265a-04c2-48e3-a6e2-dc2a61e0fea7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:28.898951 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fb45265a-04c2-48e3-a6e2-dc2a61e0fea7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:28.959175 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-fb45265a-04c2-48e3-a6e2-dc2a61e0fea7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:28.967488 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-fb45265a-04c2-48e3-a6e2-dc2a61e0fea7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081667 Jun 22 09:27:28.968368 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 840/1634] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:28 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:29.985410 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-9db8e92d-b900-48f4-8d7b-6006ad01cb21 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:29.986007 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-9db8e92d-b900-48f4-8d7b-6006ad01cb21 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:29.993894 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9db8e92d-b900-48f4-8d7b-6006ad01cb21 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:29.994344 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9db8e92d-b900-48f4-8d7b-6006ad01cb21 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:29.995107 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9db8e92d-b900-48f4-8d7b-6006ad01cb21 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:29.995545 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9db8e92d-b900-48f4-8d7b-6006ad01cb21 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:29.998151 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=84 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:27:30.057163 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-9db8e92d-b900-48f4-8d7b-6006ad01cb21 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:30.065017 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-9db8e92d-b900-48f4-8d7b-6006ad01cb21 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083487 Jun 22 09:27:30.065573 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 795/1635] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:29 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:31.082174 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e93cf8e5-8329-4864-9d84-e8cdb6e7f881 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:31.082790 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e93cf8e5-8329-4864-9d84-e8cdb6e7f881 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:31.090056 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e93cf8e5-8329-4864-9d84-e8cdb6e7f881 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:31.090498 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e93cf8e5-8329-4864-9d84-e8cdb6e7f881 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:31.091248 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e93cf8e5-8329-4864-9d84-e8cdb6e7f881 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:31.091680 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e93cf8e5-8329-4864-9d84-e8cdb6e7f881 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:31.153629 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-e93cf8e5-8329-4864-9d84-e8cdb6e7f881 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:31.162100 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e93cf8e5-8329-4864-9d84-e8cdb6e7f881 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083128 Jun 22 09:27:31.162684 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 841/1636] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:31 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:32.179022 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c2b9c0ee-0a65-4da9-89a5-1208483b295e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:32.179647 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c2b9c0ee-0a65-4da9-89a5-1208483b295e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:32.186195 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c2b9c0ee-0a65-4da9-89a5-1208483b295e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:32.186647 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c2b9c0ee-0a65-4da9-89a5-1208483b295e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:32.187412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c2b9c0ee-0a65-4da9-89a5-1208483b295e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:32.187857 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c2b9c0ee-0a65-4da9-89a5-1208483b295e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:32.483560 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-c2b9c0ee-0a65-4da9-89a5-1208483b295e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:32.492358 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c2b9c0ee-0a65-4da9-89a5-1208483b295e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.317869 Jun 22 09:27:32.492996 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 796/1637] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:32 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:33.509724 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d1dbc3be-9914-4dea-9ba9-a9eea545a89f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:33.510408 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-d1dbc3be-9914-4dea-9ba9-a9eea545a89f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:33.517338 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d1dbc3be-9914-4dea-9ba9-a9eea545a89f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:33.517815 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d1dbc3be-9914-4dea-9ba9-a9eea545a89f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:33.518598 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d1dbc3be-9914-4dea-9ba9-a9eea545a89f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:33.519053 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d1dbc3be-9914-4dea-9ba9-a9eea545a89f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:33.584194 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-d1dbc3be-9914-4dea-9ba9-a9eea545a89f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:33.592037 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d1dbc3be-9914-4dea-9ba9-a9eea545a89f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.086865 Jun 22 09:27:33.592585 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 842/1638] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:33 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:27:34.609802 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-29c07721-77e4-479f-9877-2e46c649c2db tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:34.610412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-29c07721-77e4-479f-9877-2e46c649c2db tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:34.617323 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-29c07721-77e4-479f-9877-2e46c649c2db tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:34.617769 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-29c07721-77e4-479f-9877-2e46c649c2db tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:34.618521 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-29c07721-77e4-479f-9877-2e46c649c2db tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:34.618956 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-29c07721-77e4-479f-9877-2e46c649c2db tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:34.678689 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-29c07721-77e4-479f-9877-2e46c649c2db tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:34.686554 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-29c07721-77e4-479f-9877-2e46c649c2db tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.080607 Jun 22 09:27:34.687114 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 797/1639] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:34 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:35.704067 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-dd76ec02-9358-4807-aa48-b3920175bae0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:35.704681 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-dd76ec02-9358-4807-aa48-b3920175bae0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:35.707006 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=28 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:27:35.712231 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dd76ec02-9358-4807-aa48-b3920175bae0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:35.712681 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dd76ec02-9358-4807-aa48-b3920175bae0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:35.713546 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dd76ec02-9358-4807-aa48-b3920175bae0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:35.713989 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dd76ec02-9358-4807-aa48-b3920175bae0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:35.775736 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-dd76ec02-9358-4807-aa48-b3920175bae0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:35.783638 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-dd76ec02-9358-4807-aa48-b3920175bae0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083408 Jun 22 09:27:35.784187 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 843/1640] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:35 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:36.800535 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-2bb6f644-1a78-46d0-81f6-c37637ed9c39 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:36.801207 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-2bb6f644-1a78-46d0-81f6-c37637ed9c39 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:36.804090 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=28 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:27:36.809154 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2bb6f644-1a78-46d0-81f6-c37637ed9c39 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:36.809601 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2bb6f644-1a78-46d0-81f6-c37637ed9c39 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:36.810395 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2bb6f644-1a78-46d0-81f6-c37637ed9c39 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:36.810830 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2bb6f644-1a78-46d0-81f6-c37637ed9c39 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:36.874625 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-2bb6f644-1a78-46d0-81f6-c37637ed9c39 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:36.882935 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-2bb6f644-1a78-46d0-81f6-c37637ed9c39 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.086207 Jun 22 09:27:36.883487 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 798/1641] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:36 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:37.899077 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-990ab137-c790-4b36-aa67-be85b6f4f1da tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:37.899720 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-990ab137-c790-4b36-aa67-be85b6f4f1da tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:37.906333 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-990ab137-c790-4b36-aa67-be85b6f4f1da tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:37.906786 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-990ab137-c790-4b36-aa67-be85b6f4f1da tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:37.907566 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-990ab137-c790-4b36-aa67-be85b6f4f1da tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:37.907988 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-990ab137-c790-4b36-aa67-be85b6f4f1da tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:37.910542 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=84 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:27:37.972223 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-990ab137-c790-4b36-aa67-be85b6f4f1da tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:37.980629 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-990ab137-c790-4b36-aa67-be85b6f4f1da tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.085361 Jun 22 09:27:37.981234 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 844/1642] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:37 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:38.998183 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-99593481-a02c-4b6c-8583-9daa25580388 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:38.998775 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-99593481-a02c-4b6c-8583-9daa25580388 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:39.004939 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-99593481-a02c-4b6c-8583-9daa25580388 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:39.005878 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-99593481-a02c-4b6c-8583-9daa25580388 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:39.006645 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-99593481-a02c-4b6c-8583-9daa25580388 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:39.007085 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-99593481-a02c-4b6c-8583-9daa25580388 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:39.065298 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-99593481-a02c-4b6c-8583-9daa25580388 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:39.073730 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-99593481-a02c-4b6c-8583-9daa25580388 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.079611 Jun 22 09:27:39.074297 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 799/1643] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:38 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:40.090632 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a7b3b463-58e1-4f1e-9ae9-e5ff9918d7fa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:40.091444 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-a7b3b463-58e1-4f1e-9ae9-e5ff9918d7fa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:40.098205 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a7b3b463-58e1-4f1e-9ae9-e5ff9918d7fa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:40.100398 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a7b3b463-58e1-4f1e-9ae9-e5ff9918d7fa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:40.100398 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a7b3b463-58e1-4f1e-9ae9-e5ff9918d7fa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:40.100702 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a7b3b463-58e1-4f1e-9ae9-e5ff9918d7fa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:40.160605 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-a7b3b463-58e1-4f1e-9ae9-e5ff9918d7fa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:40.169110 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a7b3b463-58e1-4f1e-9ae9-e5ff9918d7fa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082309 Jun 22 09:27:40.169666 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 845/1644] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:40 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:41.186349 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a66fabf8-7607-4a9a-9ca9-21c2ec15647b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:41.186993 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a66fabf8-7607-4a9a-9ca9-21c2ec15647b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:41.193982 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a66fabf8-7607-4a9a-9ca9-21c2ec15647b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:41.194468 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a66fabf8-7607-4a9a-9ca9-21c2ec15647b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:41.195259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a66fabf8-7607-4a9a-9ca9-21c2ec15647b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:41.195719 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a66fabf8-7607-4a9a-9ca9-21c2ec15647b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:41.309197 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-a66fabf8-7607-4a9a-9ca9-21c2ec15647b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:41.317783 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a66fabf8-7607-4a9a-9ca9-21c2ec15647b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.135270 Jun 22 09:27:41.319054 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 800/1645] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:41 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:42.334108 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-0717ca88-9b6c-4812-b8bd-7b9603e61326 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:42.334799 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-0717ca88-9b6c-4812-b8bd-7b9603e61326 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:42.341510 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0717ca88-9b6c-4812-b8bd-7b9603e61326 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:42.341957 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0717ca88-9b6c-4812-b8bd-7b9603e61326 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:42.342708 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0717ca88-9b6c-4812-b8bd-7b9603e61326 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:42.343140 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0717ca88-9b6c-4812-b8bd-7b9603e61326 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:42.409557 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-0717ca88-9b6c-4812-b8bd-7b9603e61326 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:42.417761 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-0717ca88-9b6c-4812-b8bd-7b9603e61326 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.087714 Jun 22 09:27:42.421436 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 846/1646] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:42 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:43.434855 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-fb995180-5ab8-473d-aa09-8702b3be27c9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:43.435467 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-fb995180-5ab8-473d-aa09-8702b3be27c9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:43.441940 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fb995180-5ab8-473d-aa09-8702b3be27c9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:43.442468 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fb995180-5ab8-473d-aa09-8702b3be27c9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:43.443173 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fb995180-5ab8-473d-aa09-8702b3be27c9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:43.443609 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fb995180-5ab8-473d-aa09-8702b3be27c9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:43.504323 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-fb995180-5ab8-473d-aa09-8702b3be27c9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:43.512354 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-fb995180-5ab8-473d-aa09-8702b3be27c9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081309 Jun 22 09:27:43.512936 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 801/1647] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:43 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:44.528914 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-76dbe06b-5366-42bf-ac41-fa150ae1751c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:44.529461 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-76dbe06b-5366-42bf-ac41-fa150ae1751c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:44.535909 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-76dbe06b-5366-42bf-ac41-fa150ae1751c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:44.536354 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-76dbe06b-5366-42bf-ac41-fa150ae1751c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:44.537894 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-76dbe06b-5366-42bf-ac41-fa150ae1751c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:44.538373 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-76dbe06b-5366-42bf-ac41-fa150ae1751c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:44.597359 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-76dbe06b-5366-42bf-ac41-fa150ae1751c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:44.605942 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-76dbe06b-5366-42bf-ac41-fa150ae1751c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081027 Jun 22 09:27:44.606490 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 847/1648] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:44 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:45.623320 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-86f35e51-932a-4aed-b347-3a349e6ed52e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:45.624041 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-86f35e51-932a-4aed-b347-3a349e6ed52e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:45.630725 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-86f35e51-932a-4aed-b347-3a349e6ed52e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:45.631172 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-86f35e51-932a-4aed-b347-3a349e6ed52e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:45.631933 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-86f35e51-932a-4aed-b347-3a349e6ed52e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:45.632366 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-86f35e51-932a-4aed-b347-3a349e6ed52e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:45.695751 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-86f35e51-932a-4aed-b347-3a349e6ed52e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:45.703706 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-86f35e51-932a-4aed-b347-3a349e6ed52e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084440 Jun 22 09:27:45.704271 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 802/1649] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:45 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:27:46.722424 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-94be2d4e-66f9-4ffd-9295-6872c2d73aef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:46.723015 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-94be2d4e-66f9-4ffd-9295-6872c2d73aef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:46.729730 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-94be2d4e-66f9-4ffd-9295-6872c2d73aef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:46.730176 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-94be2d4e-66f9-4ffd-9295-6872c2d73aef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:46.730934 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-94be2d4e-66f9-4ffd-9295-6872c2d73aef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:46.731365 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-94be2d4e-66f9-4ffd-9295-6872c2d73aef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:46.792733 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-94be2d4e-66f9-4ffd-9295-6872c2d73aef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:46.800729 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-94be2d4e-66f9-4ffd-9295-6872c2d73aef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082181 Jun 22 09:27:46.801318 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 848/1650] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:46 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:47.818256 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6a2a6813-57e3-4d3b-a289-295d0247d8e6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:47.818869 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-6a2a6813-57e3-4d3b-a289-295d0247d8e6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:47.825400 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6a2a6813-57e3-4d3b-a289-295d0247d8e6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:47.825851 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6a2a6813-57e3-4d3b-a289-295d0247d8e6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:47.826610 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6a2a6813-57e3-4d3b-a289-295d0247d8e6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:47.827046 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6a2a6813-57e3-4d3b-a289-295d0247d8e6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:47.889286 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-6a2a6813-57e3-4d3b-a289-295d0247d8e6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:47.897170 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-6a2a6813-57e3-4d3b-a289-295d0247d8e6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082777 Jun 22 09:27:47.898239 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 803/1651] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:47 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:48.915211 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-3858122d-1431-4bbc-a626-c71cdbc453d7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:48.915834 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-3858122d-1431-4bbc-a626-c71cdbc453d7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:48.922367 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3858122d-1431-4bbc-a626-c71cdbc453d7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:48.922814 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3858122d-1431-4bbc-a626-c71cdbc453d7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:48.923593 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3858122d-1431-4bbc-a626-c71cdbc453d7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:48.924030 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3858122d-1431-4bbc-a626-c71cdbc453d7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:48.987395 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-3858122d-1431-4bbc-a626-c71cdbc453d7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:48.996435 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-3858122d-1431-4bbc-a626-c71cdbc453d7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.085629 Jun 22 09:27:48.997056 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 849/1652] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:48 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:50.013599 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c1b3760d-9674-4f11-90b2-daa79f0563a0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:50.014209 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c1b3760d-9674-4f11-90b2-daa79f0563a0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:50.020799 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c1b3760d-9674-4f11-90b2-daa79f0563a0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:50.021264 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c1b3760d-9674-4f11-90b2-daa79f0563a0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:50.022026 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c1b3760d-9674-4f11-90b2-daa79f0563a0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:50.022465 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c1b3760d-9674-4f11-90b2-daa79f0563a0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:50.083900 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-c1b3760d-9674-4f11-90b2-daa79f0563a0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:50.092513 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c1b3760d-9674-4f11-90b2-daa79f0563a0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082871 Jun 22 09:27:50.093112 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 804/1653] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:50 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:51.110327 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-ce8028cd-8943-41d2-8479-7f609cfa6aad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:51.110938 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-ce8028cd-8943-41d2-8479-7f609cfa6aad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:51.118676 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ce8028cd-8943-41d2-8479-7f609cfa6aad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:51.119136 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ce8028cd-8943-41d2-8479-7f609cfa6aad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:51.119934 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ce8028cd-8943-41d2-8479-7f609cfa6aad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:51.120396 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ce8028cd-8943-41d2-8479-7f609cfa6aad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:51.182093 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-ce8028cd-8943-41d2-8479-7f609cfa6aad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:51.190101 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-ce8028cd-8943-41d2-8479-7f609cfa6aad tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083865 Jun 22 09:27:51.190672 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 850/1654] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:51 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:52.206326 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-61045151-4cd7-4307-9ab7-0bd5981a5a7c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:52.206981 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-61045151-4cd7-4307-9ab7-0bd5981a5a7c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:52.214204 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-61045151-4cd7-4307-9ab7-0bd5981a5a7c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:52.214647 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-61045151-4cd7-4307-9ab7-0bd5981a5a7c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:52.215879 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-61045151-4cd7-4307-9ab7-0bd5981a5a7c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:52.215879 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-61045151-4cd7-4307-9ab7-0bd5981a5a7c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:52.276203 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-61045151-4cd7-4307-9ab7-0bd5981a5a7c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:52.284104 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-61045151-4cd7-4307-9ab7-0bd5981a5a7c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081646 Jun 22 09:27:52.284651 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 805/1655] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:52 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:53.301752 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-187447b2-a605-419f-8c64-6b409df65068 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:53.302369 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-187447b2-a605-419f-8c64-6b409df65068 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:53.309695 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-187447b2-a605-419f-8c64-6b409df65068 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:53.310147 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-187447b2-a605-419f-8c64-6b409df65068 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:53.310902 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-187447b2-a605-419f-8c64-6b409df65068 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:53.311343 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-187447b2-a605-419f-8c64-6b409df65068 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:53.373110 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-187447b2-a605-419f-8c64-6b409df65068 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:53.381077 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-187447b2-a605-419f-8c64-6b409df65068 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083219 Jun 22 09:27:53.381634 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 851/1656] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:53 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:54.401768 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-662ed1b2-7cab-415f-9df5-d78e5fb8f7d1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:54.402388 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-662ed1b2-7cab-415f-9df5-d78e5fb8f7d1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:54.408916 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-662ed1b2-7cab-415f-9df5-d78e5fb8f7d1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:54.409363 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-662ed1b2-7cab-415f-9df5-d78e5fb8f7d1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:54.410112 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-662ed1b2-7cab-415f-9df5-d78e5fb8f7d1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:54.410545 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-662ed1b2-7cab-415f-9df5-d78e5fb8f7d1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:54.472965 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-662ed1b2-7cab-415f-9df5-d78e5fb8f7d1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:54.481039 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-662ed1b2-7cab-415f-9df5-d78e5fb8f7d1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084490 Jun 22 09:27:54.481593 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 806/1657] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:54 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:55.498115 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7e0837d8-4023-41ca-9f4a-23907e4de713 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:55.498730 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7e0837d8-4023-41ca-9f4a-23907e4de713 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:55.505293 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7e0837d8-4023-41ca-9f4a-23907e4de713 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:55.505749 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7e0837d8-4023-41ca-9f4a-23907e4de713 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:55.506514 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7e0837d8-4023-41ca-9f4a-23907e4de713 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:55.506963 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7e0837d8-4023-41ca-9f4a-23907e4de713 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:55.567845 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7e0837d8-4023-41ca-9f4a-23907e4de713 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:55.576246 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7e0837d8-4023-41ca-9f4a-23907e4de713 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082020 Jun 22 09:27:55.576866 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 852/1658] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:55 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:56.594709 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-d938b59e-2bfe-4ff2-9d1a-ce1ae190d254 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:56.595319 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-d938b59e-2bfe-4ff2-9d1a-ce1ae190d254 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:56.601995 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d938b59e-2bfe-4ff2-9d1a-ce1ae190d254 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:56.602438 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d938b59e-2bfe-4ff2-9d1a-ce1ae190d254 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:56.603192 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d938b59e-2bfe-4ff2-9d1a-ce1ae190d254 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:56.603625 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d938b59e-2bfe-4ff2-9d1a-ce1ae190d254 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:56.664976 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-d938b59e-2bfe-4ff2-9d1a-ce1ae190d254 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:56.673075 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-d938b59e-2bfe-4ff2-9d1a-ce1ae190d254 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082212 Jun 22 09:27:56.673624 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 807/1659] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:56 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:57.690009 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-90108d7e-e286-41ee-b2ca-5c4042485c62 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:57.690619 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-90108d7e-e286-41ee-b2ca-5c4042485c62 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:57.697215 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-90108d7e-e286-41ee-b2ca-5c4042485c62 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:57.697660 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-90108d7e-e286-41ee-b2ca-5c4042485c62 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:57.698411 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-90108d7e-e286-41ee-b2ca-5c4042485c62 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:57.699126 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-90108d7e-e286-41ee-b2ca-5c4042485c62 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:57.759201 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-90108d7e-e286-41ee-b2ca-5c4042485c62 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:57.767148 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-90108d7e-e286-41ee-b2ca-5c4042485c62 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.080963 Jun 22 09:27:57.767705 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 853/1660] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:57 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:58.784547 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c8b648a7-6776-4197-9981-d0edca0323a6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:58.785181 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c8b648a7-6776-4197-9981-d0edca0323a6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:58.792102 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c8b648a7-6776-4197-9981-d0edca0323a6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:58.792541 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c8b648a7-6776-4197-9981-d0edca0323a6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:58.793327 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c8b648a7-6776-4197-9981-d0edca0323a6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:58.793763 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c8b648a7-6776-4197-9981-d0edca0323a6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:58.856238 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-c8b648a7-6776-4197-9981-d0edca0323a6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:58.864155 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c8b648a7-6776-4197-9981-d0edca0323a6 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083436 Jun 22 09:27:58.864987 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 808/1661] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:58 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:27:59.881807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-22f280ee-b918-48a4-930f-d061038b467a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:27:59.883195 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-22f280ee-b918-48a4-930f-d061038b467a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:27:59.889689 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-22f280ee-b918-48a4-930f-d061038b467a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:59.890141 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-22f280ee-b918-48a4-930f-d061038b467a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:59.890892 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-22f280ee-b918-48a4-930f-d061038b467a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:27:59.891328 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-22f280ee-b918-48a4-930f-d061038b467a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:27:59.951295 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-22f280ee-b918-48a4-930f-d061038b467a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:27:59.959207 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-22f280ee-b918-48a4-930f-d061038b467a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081205 Jun 22 09:27:59.959763 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 854/1662] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:27:59 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:00.975659 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-7939793a-bf44-4611-b597-7ee9869f642c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:00.976367 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-7939793a-bf44-4611-b597-7ee9869f642c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:00.982947 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7939793a-bf44-4611-b597-7ee9869f642c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:00.983393 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7939793a-bf44-4611-b597-7ee9869f642c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:00.984147 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7939793a-bf44-4611-b597-7ee9869f642c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:00.984607 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7939793a-bf44-4611-b597-7ee9869f642c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:00.987138 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=84 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:28:01.045696 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-7939793a-bf44-4611-b597-7ee9869f642c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:01.053502 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-7939793a-bf44-4611-b597-7ee9869f642c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081831 Jun 22 09:28:01.054280 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 809/1663] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:00 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:02.071334 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-de70597b-3786-4fad-b363-25d5525f6c17 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:02.071935 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-de70597b-3786-4fad-b363-25d5525f6c17 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:02.078381 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-de70597b-3786-4fad-b363-25d5525f6c17 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:02.078824 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-de70597b-3786-4fad-b363-25d5525f6c17 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:02.079580 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-de70597b-3786-4fad-b363-25d5525f6c17 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:02.080013 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-de70597b-3786-4fad-b363-25d5525f6c17 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:02.142196 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-de70597b-3786-4fad-b363-25d5525f6c17 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:02.150701 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-de70597b-3786-4fad-b363-25d5525f6c17 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084107 Jun 22 09:28:02.151258 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 855/1664] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:02 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:03.168071 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-e21ab46f-85ff-4f83-b102-151616637250 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:03.168682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-e21ab46f-85ff-4f83-b102-151616637250 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:03.175637 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e21ab46f-85ff-4f83-b102-151616637250 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:03.176081 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e21ab46f-85ff-4f83-b102-151616637250 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:03.176873 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e21ab46f-85ff-4f83-b102-151616637250 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:03.177306 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e21ab46f-85ff-4f83-b102-151616637250 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:03.243782 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-e21ab46f-85ff-4f83-b102-151616637250 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:03.251655 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-e21ab46f-85ff-4f83-b102-151616637250 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.087434 Jun 22 09:28:03.252206 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 810/1665] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:03 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:04.268729 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-67b58459-e8d4-4257-98b0-133c451c569e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:04.269412 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-67b58459-e8d4-4257-98b0-133c451c569e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:04.276471 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-67b58459-e8d4-4257-98b0-133c451c569e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:04.276975 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-67b58459-e8d4-4257-98b0-133c451c569e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:04.277744 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-67b58459-e8d4-4257-98b0-133c451c569e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:04.278188 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-67b58459-e8d4-4257-98b0-133c451c569e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:04.339140 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-67b58459-e8d4-4257-98b0-133c451c569e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:04.347076 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-67b58459-e8d4-4257-98b0-133c451c569e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082282 Jun 22 09:28:04.347638 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 856/1666] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:04 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:05.364179 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-cfdacb5f-6821-4830-b166-455f60f74afc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:05.365161 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-cfdacb5f-6821-4830-b166-455f60f74afc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:05.372198 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cfdacb5f-6821-4830-b166-455f60f74afc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:05.372647 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cfdacb5f-6821-4830-b166-455f60f74afc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:05.373440 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cfdacb5f-6821-4830-b166-455f60f74afc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:05.373876 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-cfdacb5f-6821-4830-b166-455f60f74afc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:05.442399 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-cfdacb5f-6821-4830-b166-455f60f74afc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:05.451160 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-cfdacb5f-6821-4830-b166-455f60f74afc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.090810 Jun 22 09:28:05.451733 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 811/1667] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:05 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:06.468833 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-efcb9a13-4c47-4254-9e18-6c2d168512bb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:06.469386 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-efcb9a13-4c47-4254-9e18-6c2d168512bb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:06.471672 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=28 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:28:06.477063 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-efcb9a13-4c47-4254-9e18-6c2d168512bb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:06.477514 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-efcb9a13-4c47-4254-9e18-6c2d168512bb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:06.478296 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-efcb9a13-4c47-4254-9e18-6c2d168512bb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:06.478767 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-efcb9a13-4c47-4254-9e18-6c2d168512bb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:06.540011 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-efcb9a13-4c47-4254-9e18-6c2d168512bb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:06.547945 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-efcb9a13-4c47-4254-9e18-6c2d168512bb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083205 Jun 22 09:28:06.548504 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 857/1668] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:06 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:07.564967 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b42ed3de-a419-4981-a46b-7765b9057d82 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:07.565576 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-b42ed3de-a419-4981-a46b-7765b9057d82 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:07.567953 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=28 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:28:07.573459 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b42ed3de-a419-4981-a46b-7765b9057d82 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:07.573896 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b42ed3de-a419-4981-a46b-7765b9057d82 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:07.574652 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b42ed3de-a419-4981-a46b-7765b9057d82 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:07.575083 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b42ed3de-a419-4981-a46b-7765b9057d82 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:07.638343 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-b42ed3de-a419-4981-a46b-7765b9057d82 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:07.646218 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-b42ed3de-a419-4981-a46b-7765b9057d82 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.085136 Jun 22 09:28:07.646774 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 812/1669] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:07 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:08.663942 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-4b246c02-5845-434e-a99e-b6f4519f78e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:08.664749 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-4b246c02-5845-434e-a99e-b6f4519f78e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:08.671555 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4b246c02-5845-434e-a99e-b6f4519f78e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:08.671999 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4b246c02-5845-434e-a99e-b6f4519f78e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:08.672755 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4b246c02-5845-434e-a99e-b6f4519f78e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:08.673213 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4b246c02-5845-434e-a99e-b6f4519f78e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:08.677091 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=84 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:28:08.734026 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-4b246c02-5845-434e-a99e-b6f4519f78e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:08.742816 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-4b246c02-5845-434e-a99e-b6f4519f78e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082856 Jun 22 09:28:08.743374 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 858/1670] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:08 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:09.759988 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3d32f48e-b6cf-4fe0-92e6-7134b2ac1a92 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:09.760536 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3d32f48e-b6cf-4fe0-92e6-7134b2ac1a92 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:09.766683 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3d32f48e-b6cf-4fe0-92e6-7134b2ac1a92 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:09.767129 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3d32f48e-b6cf-4fe0-92e6-7134b2ac1a92 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:09.767879 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3d32f48e-b6cf-4fe0-92e6-7134b2ac1a92 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:09.768312 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3d32f48e-b6cf-4fe0-92e6-7134b2ac1a92 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:09.833999 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3d32f48e-b6cf-4fe0-92e6-7134b2ac1a92 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:09.837317 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3d32f48e-b6cf-4fe0-92e6-7134b2ac1a92 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081355 Jun 22 09:28:09.837898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 813/1671] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:09 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:10.854133 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e1c7de40-3949-4a41-8d0f-ab08fe9823e7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:10.854810 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e1c7de40-3949-4a41-8d0f-ab08fe9823e7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:10.861256 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e1c7de40-3949-4a41-8d0f-ab08fe9823e7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:10.861699 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e1c7de40-3949-4a41-8d0f-ab08fe9823e7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:10.862451 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e1c7de40-3949-4a41-8d0f-ab08fe9823e7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:10.862880 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e1c7de40-3949-4a41-8d0f-ab08fe9823e7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:10.923612 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-e1c7de40-3949-4a41-8d0f-ab08fe9823e7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:10.932012 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e1c7de40-3949-4a41-8d0f-ab08fe9823e7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081785 Jun 22 09:28:10.932575 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 859/1672] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:10 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:11.950329 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b7609bbb-7eaf-4093-a10a-b337a21181ff tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:11.951014 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-b7609bbb-7eaf-4093-a10a-b337a21181ff tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:11.958106 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b7609bbb-7eaf-4093-a10a-b337a21181ff tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:11.958560 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b7609bbb-7eaf-4093-a10a-b337a21181ff tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:11.959381 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b7609bbb-7eaf-4093-a10a-b337a21181ff tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:11.959857 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b7609bbb-7eaf-4093-a10a-b337a21181ff tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:12.023572 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-b7609bbb-7eaf-4093-a10a-b337a21181ff tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:12.031683 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-b7609bbb-7eaf-4093-a10a-b337a21181ff tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.086082 Jun 22 09:28:12.032235 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 814/1673] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:11 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:13.098085 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-97074864-6a73-4995-9f36-4d9f10854d7b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:13.098717 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-97074864-6a73-4995-9f36-4d9f10854d7b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:13.105001 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-97074864-6a73-4995-9f36-4d9f10854d7b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:13.105459 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-97074864-6a73-4995-9f36-4d9f10854d7b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:13.106228 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-97074864-6a73-4995-9f36-4d9f10854d7b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:13.106673 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-97074864-6a73-4995-9f36-4d9f10854d7b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:13.166496 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-97074864-6a73-4995-9f36-4d9f10854d7b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:13.174815 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-97074864-6a73-4995-9f36-4d9f10854d7b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.129747 Jun 22 09:28:13.175382 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 860/1674] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:13 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:13.315110 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:28:13.315290 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Wed Jun 22 09:28:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:28:14.191886 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-9bbe8b8a-102e-4079-a684-6485c68b9b9c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:14.192626 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-9bbe8b8a-102e-4079-a684-6485c68b9b9c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:14.199339 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9bbe8b8a-102e-4079-a684-6485c68b9b9c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:14.199806 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9bbe8b8a-102e-4079-a684-6485c68b9b9c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:14.200552 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9bbe8b8a-102e-4079-a684-6485c68b9b9c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:14.201018 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9bbe8b8a-102e-4079-a684-6485c68b9b9c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:14.261519 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-9bbe8b8a-102e-4079-a684-6485c68b9b9c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:14.269460 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-9bbe8b8a-102e-4079-a684-6485c68b9b9c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081544 Jun 22 09:28:14.270019 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 815/1675] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:14 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:15.287091 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a03969e0-b853-48dc-bfcd-3af4bfe98d3d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:15.287728 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-a03969e0-b853-48dc-bfcd-3af4bfe98d3d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:15.294523 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a03969e0-b853-48dc-bfcd-3af4bfe98d3d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:15.294969 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a03969e0-b853-48dc-bfcd-3af4bfe98d3d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:15.295731 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a03969e0-b853-48dc-bfcd-3af4bfe98d3d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:15.296170 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a03969e0-b853-48dc-bfcd-3af4bfe98d3d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:15.356196 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-a03969e0-b853-48dc-bfcd-3af4bfe98d3d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:15.364391 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a03969e0-b853-48dc-bfcd-3af4bfe98d3d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.080903 Jun 22 09:28:15.364988 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 861/1676] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:15 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:16.381886 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-9bf585d8-b272-4441-9cf6-4f264237848b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:16.382507 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-9bf585d8-b272-4441-9cf6-4f264237848b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:16.389683 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9bf585d8-b272-4441-9cf6-4f264237848b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:16.390129 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9bf585d8-b272-4441-9cf6-4f264237848b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:16.390891 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9bf585d8-b272-4441-9cf6-4f264237848b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:16.391328 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9bf585d8-b272-4441-9cf6-4f264237848b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:16.455375 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-9bf585d8-b272-4441-9cf6-4f264237848b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:16.463571 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-9bf585d8-b272-4441-9cf6-4f264237848b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.085644 Jun 22 09:28:16.464134 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 816/1677] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:16 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:17.480009 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-25c9c57e-180e-49f1-9e09-4e0b813384d4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:17.480639 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-25c9c57e-180e-49f1-9e09-4e0b813384d4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:17.487518 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-25c9c57e-180e-49f1-9e09-4e0b813384d4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:17.488062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-25c9c57e-180e-49f1-9e09-4e0b813384d4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:17.489071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-25c9c57e-180e-49f1-9e09-4e0b813384d4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:17.489512 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-25c9c57e-180e-49f1-9e09-4e0b813384d4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:17.553109 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-25c9c57e-180e-49f1-9e09-4e0b813384d4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:17.561129 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-25c9c57e-180e-49f1-9e09-4e0b813384d4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.085119 Jun 22 09:28:17.561690 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 862/1678] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:17 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:18.578438 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-068b9dd9-c445-4bcc-a113-9b2110cbe90c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:18.579053 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-068b9dd9-c445-4bcc-a113-9b2110cbe90c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:18.585581 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-068b9dd9-c445-4bcc-a113-9b2110cbe90c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:18.586031 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-068b9dd9-c445-4bcc-a113-9b2110cbe90c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:18.586839 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-068b9dd9-c445-4bcc-a113-9b2110cbe90c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:18.587286 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-068b9dd9-c445-4bcc-a113-9b2110cbe90c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:18.650967 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-068b9dd9-c445-4bcc-a113-9b2110cbe90c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:18.658945 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-068b9dd9-c445-4bcc-a113-9b2110cbe90c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084417 Jun 22 09:28:18.659504 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 817/1679] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:18 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:19.209937 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:28:19.210482 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Wed Jun 22 09:28:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:28:19.675808 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f788c037-3703-4393-a9f8-9ed6173ec30f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:19.676444 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-f788c037-3703-4393-a9f8-9ed6173ec30f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:19.683564 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f788c037-3703-4393-a9f8-9ed6173ec30f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:19.684011 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f788c037-3703-4393-a9f8-9ed6173ec30f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:19.684763 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f788c037-3703-4393-a9f8-9ed6173ec30f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:19.685216 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f788c037-3703-4393-a9f8-9ed6173ec30f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:19.746633 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-f788c037-3703-4393-a9f8-9ed6173ec30f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:19.754588 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f788c037-3703-4393-a9f8-9ed6173ec30f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082627 Jun 22 09:28:19.755144 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 863/1680] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:19 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:20.771255 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-35fc19ec-6ac7-474a-8ae7-ab4c7cea3e55 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:20.771891 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-35fc19ec-6ac7-474a-8ae7-ab4c7cea3e55 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:20.779284 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-35fc19ec-6ac7-474a-8ae7-ab4c7cea3e55 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:20.779738 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-35fc19ec-6ac7-474a-8ae7-ab4c7cea3e55 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:20.780604 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-35fc19ec-6ac7-474a-8ae7-ab4c7cea3e55 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:20.781076 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-35fc19ec-6ac7-474a-8ae7-ab4c7cea3e55 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:20.846246 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-35fc19ec-6ac7-474a-8ae7-ab4c7cea3e55 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:20.854913 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-35fc19ec-6ac7-474a-8ae7-ab4c7cea3e55 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.087534 Jun 22 09:28:20.855479 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 818/1681] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:20 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:21.871777 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c1dad700-040e-46c3-9c5d-6d65e8550bd2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:21.872343 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c1dad700-040e-46c3-9c5d-6d65e8550bd2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:21.878882 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c1dad700-040e-46c3-9c5d-6d65e8550bd2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:21.879328 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c1dad700-040e-46c3-9c5d-6d65e8550bd2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:21.880078 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c1dad700-040e-46c3-9c5d-6d65e8550bd2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:21.880512 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c1dad700-040e-46c3-9c5d-6d65e8550bd2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:21.941543 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c1dad700-040e-46c3-9c5d-6d65e8550bd2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:21.949607 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c1dad700-040e-46c3-9c5d-6d65e8550bd2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082345 Jun 22 09:28:21.950163 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 864/1682] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:21 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:22.966438 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a8857e3d-e8bf-4e9b-beb4-3ce8d5432bca tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:22.967103 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a8857e3d-e8bf-4e9b-beb4-3ce8d5432bca tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:22.973724 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a8857e3d-e8bf-4e9b-beb4-3ce8d5432bca tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:22.974113 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a8857e3d-e8bf-4e9b-beb4-3ce8d5432bca tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:22.974864 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a8857e3d-e8bf-4e9b-beb4-3ce8d5432bca tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:22.975298 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a8857e3d-e8bf-4e9b-beb4-3ce8d5432bca tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:23.035598 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-a8857e3d-e8bf-4e9b-beb4-3ce8d5432bca tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:23.043642 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a8857e3d-e8bf-4e9b-beb4-3ce8d5432bca tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081120 Jun 22 09:28:23.044200 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 819/1683] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:22 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:24.060300 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7c45686c-433a-41a3-82d8-ec528b4b2a7f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:24.060944 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7c45686c-433a-41a3-82d8-ec528b4b2a7f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:24.067552 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7c45686c-433a-41a3-82d8-ec528b4b2a7f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:24.067998 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7c45686c-433a-41a3-82d8-ec528b4b2a7f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:24.068754 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7c45686c-433a-41a3-82d8-ec528b4b2a7f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:24.069206 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7c45686c-433a-41a3-82d8-ec528b4b2a7f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:24.140572 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7c45686c-433a-41a3-82d8-ec528b4b2a7f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:24.148467 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7c45686c-433a-41a3-82d8-ec528b4b2a7f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.092040 Jun 22 09:28:24.149717 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 865/1684] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:24 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:28:25.167018 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3d04748a-69fc-467a-9f17-9efd4c8230b0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:25.167562 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3d04748a-69fc-467a-9f17-9efd4c8230b0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:25.174087 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3d04748a-69fc-467a-9f17-9efd4c8230b0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:25.174545 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3d04748a-69fc-467a-9f17-9efd4c8230b0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:25.175312 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3d04748a-69fc-467a-9f17-9efd4c8230b0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:25.175751 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3d04748a-69fc-467a-9f17-9efd4c8230b0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:25.241623 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3d04748a-69fc-467a-9f17-9efd4c8230b0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:25.249947 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3d04748a-69fc-467a-9f17-9efd4c8230b0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.087626 Jun 22 09:28:25.250509 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 820/1685] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:25 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:26.267296 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-5dde5684-3ac3-44ae-8d9f-96e67fa81e2e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:26.267916 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-5dde5684-3ac3-44ae-8d9f-96e67fa81e2e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:26.275185 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5dde5684-3ac3-44ae-8d9f-96e67fa81e2e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:26.275639 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5dde5684-3ac3-44ae-8d9f-96e67fa81e2e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:26.276401 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5dde5684-3ac3-44ae-8d9f-96e67fa81e2e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:26.276871 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5dde5684-3ac3-44ae-8d9f-96e67fa81e2e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:26.337468 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-5dde5684-3ac3-44ae-8d9f-96e67fa81e2e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:26.345433 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-5dde5684-3ac3-44ae-8d9f-96e67fa81e2e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082084 Jun 22 09:28:26.345984 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 866/1686] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:26 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:27.362935 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6aad2da0-d5f5-442f-a7a6-56c5097795a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:27.363826 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-6aad2da0-d5f5-442f-a7a6-56c5097795a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:27.371192 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6aad2da0-d5f5-442f-a7a6-56c5097795a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:27.371641 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6aad2da0-d5f5-442f-a7a6-56c5097795a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:27.372406 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6aad2da0-d5f5-442f-a7a6-56c5097795a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:27.372874 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6aad2da0-d5f5-442f-a7a6-56c5097795a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:27.434213 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-6aad2da0-d5f5-442f-a7a6-56c5097795a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:27.442183 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-6aad2da0-d5f5-442f-a7a6-56c5097795a9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083338 Jun 22 09:28:27.442745 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 821/1687] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:27 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:28.459150 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-31a4282f-83f8-4cfc-bea1-6b2360285a3b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:28.459759 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-31a4282f-83f8-4cfc-bea1-6b2360285a3b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:28.466488 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-31a4282f-83f8-4cfc-bea1-6b2360285a3b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:28.466877 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-31a4282f-83f8-4cfc-bea1-6b2360285a3b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:28.467631 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-31a4282f-83f8-4cfc-bea1-6b2360285a3b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:28.468061 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-31a4282f-83f8-4cfc-bea1-6b2360285a3b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:28.528217 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-31a4282f-83f8-4cfc-bea1-6b2360285a3b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:28.536012 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-31a4282f-83f8-4cfc-bea1-6b2360285a3b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.080762 Jun 22 09:28:28.536561 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 867/1688] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:28 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:29.553459 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-d0c453bb-f0c9-4ff1-b574-09080ff15728 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:29.554079 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-d0c453bb-f0c9-4ff1-b574-09080ff15728 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:29.561222 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d0c453bb-f0c9-4ff1-b574-09080ff15728 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:29.561675 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d0c453bb-f0c9-4ff1-b574-09080ff15728 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:29.562446 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d0c453bb-f0c9-4ff1-b574-09080ff15728 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:29.562891 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d0c453bb-f0c9-4ff1-b574-09080ff15728 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:29.627175 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-d0c453bb-f0c9-4ff1-b574-09080ff15728 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:29.636361 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-d0c453bb-f0c9-4ff1-b574-09080ff15728 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.086770 Jun 22 09:28:29.636961 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 822/1689] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:29 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:30.654465 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-b3c2df00-7c1e-4fad-87c8-e5d5a963b4d1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:30.655062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-b3c2df00-7c1e-4fad-87c8-e5d5a963b4d1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:30.661573 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b3c2df00-7c1e-4fad-87c8-e5d5a963b4d1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:30.662021 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b3c2df00-7c1e-4fad-87c8-e5d5a963b4d1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:30.662784 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b3c2df00-7c1e-4fad-87c8-e5d5a963b4d1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:30.663222 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b3c2df00-7c1e-4fad-87c8-e5d5a963b4d1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:30.728984 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-b3c2df00-7c1e-4fad-87c8-e5d5a963b4d1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:30.738405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-b3c2df00-7c1e-4fad-87c8-e5d5a963b4d1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.087510 Jun 22 09:28:30.739035 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 868/1690] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:30 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:31.757767 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b2f5e000-3aaa-43e3-bd24-321459b75aa7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:31.758573 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-b2f5e000-3aaa-43e3-bd24-321459b75aa7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:31.765575 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b2f5e000-3aaa-43e3-bd24-321459b75aa7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:31.766024 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b2f5e000-3aaa-43e3-bd24-321459b75aa7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:31.766781 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b2f5e000-3aaa-43e3-bd24-321459b75aa7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:31.767222 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b2f5e000-3aaa-43e3-bd24-321459b75aa7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:31.771087 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=84 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:28:31.830192 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-b2f5e000-3aaa-43e3-bd24-321459b75aa7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:31.838167 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-b2f5e000-3aaa-43e3-bd24-321459b75aa7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084937 Jun 22 09:28:31.838658 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 823/1691] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:31 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:32.855840 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7cf996ce-1960-4f02-a081-c47e2d3d831d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:32.856534 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7cf996ce-1960-4f02-a081-c47e2d3d831d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:32.863888 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7cf996ce-1960-4f02-a081-c47e2d3d831d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:32.864527 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7cf996ce-1960-4f02-a081-c47e2d3d831d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:32.865411 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7cf996ce-1960-4f02-a081-c47e2d3d831d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:32.865897 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7cf996ce-1960-4f02-a081-c47e2d3d831d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:32.931310 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7cf996ce-1960-4f02-a081-c47e2d3d831d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:32.940112 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7cf996ce-1960-4f02-a081-c47e2d3d831d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.088271 Jun 22 09:28:32.940704 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 869/1692] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:32 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:33.958918 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-0dd6790e-ac45-45db-8154-f979fa7ef868 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:33.959464 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-0dd6790e-ac45-45db-8154-f979fa7ef868 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:33.967235 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0dd6790e-ac45-45db-8154-f979fa7ef868 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:33.967691 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0dd6790e-ac45-45db-8154-f979fa7ef868 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:33.968463 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0dd6790e-ac45-45db-8154-f979fa7ef868 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:33.968935 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0dd6790e-ac45-45db-8154-f979fa7ef868 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:34.196088 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-0dd6790e-ac45-45db-8154-f979fa7ef868 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:34.198139 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-0dd6790e-ac45-45db-8154-f979fa7ef868 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.243243 Jun 22 09:28:34.198698 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 824/1693] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:33 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:35.216028 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-ce1b70a0-b4d9-4432-8bba-bb6629741918 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:35.216459 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-ce1b70a0-b4d9-4432-8bba-bb6629741918 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:35.222902 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ce1b70a0-b4d9-4432-8bba-bb6629741918 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:35.223347 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ce1b70a0-b4d9-4432-8bba-bb6629741918 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:35.224099 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ce1b70a0-b4d9-4432-8bba-bb6629741918 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:35.224532 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ce1b70a0-b4d9-4432-8bba-bb6629741918 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:35.289946 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-ce1b70a0-b4d9-4432-8bba-bb6629741918 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:35.298084 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-ce1b70a0-b4d9-4432-8bba-bb6629741918 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.086298 Jun 22 09:28:35.298639 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 870/1694] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:35 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:36.314866 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-d8592372-ca55-4f07-9895-8be18c8c47b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:36.315470 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-d8592372-ca55-4f07-9895-8be18c8c47b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:36.322142 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d8592372-ca55-4f07-9895-8be18c8c47b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:36.322588 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d8592372-ca55-4f07-9895-8be18c8c47b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:36.323339 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d8592372-ca55-4f07-9895-8be18c8c47b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:36.323772 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d8592372-ca55-4f07-9895-8be18c8c47b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:36.383699 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-d8592372-ca55-4f07-9895-8be18c8c47b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:36.391580 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-d8592372-ca55-4f07-9895-8be18c8c47b5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.080604 Jun 22 09:28:36.392120 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 825/1695] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:36 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:37.409232 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-76398ce2-ed36-4262-b0d6-aac2ace5a30f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:37.409838 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-76398ce2-ed36-4262-b0d6-aac2ace5a30f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:37.412119 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=28 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:28:37.417067 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-76398ce2-ed36-4262-b0d6-aac2ace5a30f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:37.420662 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-76398ce2-ed36-4262-b0d6-aac2ace5a30f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:37.420662 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-76398ce2-ed36-4262-b0d6-aac2ace5a30f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:37.420662 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-76398ce2-ed36-4262-b0d6-aac2ace5a30f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:37.479674 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-76398ce2-ed36-4262-b0d6-aac2ace5a30f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:37.487467 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-76398ce2-ed36-4262-b0d6-aac2ace5a30f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082289 Jun 22 09:28:37.488274 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 871/1696] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:37 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:38.505879 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-d9578334-db81-4c25-b2fb-e98481191263 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:38.506424 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-d9578334-db81-4c25-b2fb-e98481191263 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:38.509035 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=28 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:28:38.513829 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d9578334-db81-4c25-b2fb-e98481191263 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:38.514279 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d9578334-db81-4c25-b2fb-e98481191263 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:38.515039 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d9578334-db81-4c25-b2fb-e98481191263 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:38.515475 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d9578334-db81-4c25-b2fb-e98481191263 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:38.578879 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-d9578334-db81-4c25-b2fb-e98481191263 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:38.587240 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-d9578334-db81-4c25-b2fb-e98481191263 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.085295 Jun 22 09:28:38.587795 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 826/1697] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:38 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:39.603640 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-304c740c-fb4b-444a-b7a5-bce45940082b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:39.604288 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-304c740c-fb4b-444a-b7a5-bce45940082b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:39.610782 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-304c740c-fb4b-444a-b7a5-bce45940082b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:39.611232 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-304c740c-fb4b-444a-b7a5-bce45940082b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:39.611998 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-304c740c-fb4b-444a-b7a5-bce45940082b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:39.612437 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-304c740c-fb4b-444a-b7a5-bce45940082b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:39.616560 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=84 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:28:39.673592 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-304c740c-fb4b-444a-b7a5-bce45940082b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:39.682241 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-304c740c-fb4b-444a-b7a5-bce45940082b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082727 Jun 22 09:28:39.682801 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 872/1698] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:39 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:39.793691 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:28:39.793880 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Wed Jun 22 09:28:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:28:40.699824 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-e97297a7-59f0-4a01-8ed5-049c602a8a38 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:40.700470 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-e97297a7-59f0-4a01-8ed5-049c602a8a38 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:40.706898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e97297a7-59f0-4a01-8ed5-049c602a8a38 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:40.710484 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e97297a7-59f0-4a01-8ed5-049c602a8a38 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:40.710484 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e97297a7-59f0-4a01-8ed5-049c602a8a38 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:40.710484 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e97297a7-59f0-4a01-8ed5-049c602a8a38 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:40.769400 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-e97297a7-59f0-4a01-8ed5-049c602a8a38 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:40.777994 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-e97297a7-59f0-4a01-8ed5-049c602a8a38 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082726 Jun 22 09:28:40.778551 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 827/1699] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:40 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:41.797137 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-b72e4f16-12f9-40c1-9d47-7fbcb8773e71 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:41.798205 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-b72e4f16-12f9-40c1-9d47-7fbcb8773e71 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:41.805159 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b72e4f16-12f9-40c1-9d47-7fbcb8773e71 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:41.805700 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b72e4f16-12f9-40c1-9d47-7fbcb8773e71 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:41.806440 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b72e4f16-12f9-40c1-9d47-7fbcb8773e71 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:41.806880 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b72e4f16-12f9-40c1-9d47-7fbcb8773e71 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:41.869712 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-b72e4f16-12f9-40c1-9d47-7fbcb8773e71 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:41.877830 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-b72e4f16-12f9-40c1-9d47-7fbcb8773e71 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.085808 Jun 22 09:28:41.878387 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 873/1700] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:41 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:42.894799 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-2c70e5f7-b60f-42aa-8fb4-2a901ee2ab78 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:42.895412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-2c70e5f7-b60f-42aa-8fb4-2a901ee2ab78 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:42.901924 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2c70e5f7-b60f-42aa-8fb4-2a901ee2ab78 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:42.902370 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2c70e5f7-b60f-42aa-8fb4-2a901ee2ab78 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:42.903125 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2c70e5f7-b60f-42aa-8fb4-2a901ee2ab78 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:42.903561 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2c70e5f7-b60f-42aa-8fb4-2a901ee2ab78 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:42.966476 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-2c70e5f7-b60f-42aa-8fb4-2a901ee2ab78 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:42.974476 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-2c70e5f7-b60f-42aa-8fb4-2a901ee2ab78 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083572 Jun 22 09:28:42.975022 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 828/1701] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:42 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:43.992511 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-eb15d447-4ec8-46f5-a6eb-2ad47405b8c4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:43.993152 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-eb15d447-4ec8-46f5-a6eb-2ad47405b8c4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:43.999750 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eb15d447-4ec8-46f5-a6eb-2ad47405b8c4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:44.000201 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eb15d447-4ec8-46f5-a6eb-2ad47405b8c4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:44.001008 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eb15d447-4ec8-46f5-a6eb-2ad47405b8c4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:44.001447 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eb15d447-4ec8-46f5-a6eb-2ad47405b8c4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:44.061769 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-eb15d447-4ec8-46f5-a6eb-2ad47405b8c4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:44.069600 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-eb15d447-4ec8-46f5-a6eb-2ad47405b8c4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081102 Jun 22 09:28:44.070156 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 874/1702] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:43 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:45.086953 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-375f3671-606c-4d83-abb3-f9c28ab2253d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:45.087590 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-375f3671-606c-4d83-abb3-f9c28ab2253d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:45.094170 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-375f3671-606c-4d83-abb3-f9c28ab2253d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:45.094619 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-375f3671-606c-4d83-abb3-f9c28ab2253d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:45.095374 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-375f3671-606c-4d83-abb3-f9c28ab2253d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:45.095807 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-375f3671-606c-4d83-abb3-f9c28ab2253d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:45.156462 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-375f3671-606c-4d83-abb3-f9c28ab2253d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:45.165371 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-375f3671-606c-4d83-abb3-f9c28ab2253d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082391 Jun 22 09:28:45.165921 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 829/1703] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:45 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:46.183132 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7b6b3cdc-fa2e-4d94-8089-540832d9313b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:46.183747 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7b6b3cdc-fa2e-4d94-8089-540832d9313b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:46.189976 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7b6b3cdc-fa2e-4d94-8089-540832d9313b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:46.190430 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7b6b3cdc-fa2e-4d94-8089-540832d9313b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:46.191327 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7b6b3cdc-fa2e-4d94-8089-540832d9313b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:46.191773 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7b6b3cdc-fa2e-4d94-8089-540832d9313b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:46.255278 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7b6b3cdc-fa2e-4d94-8089-540832d9313b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:46.264115 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7b6b3cdc-fa2e-4d94-8089-540832d9313b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.085485 Jun 22 09:28:46.264686 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 875/1704] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:46 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:47.282610 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-74b039cd-9a5e-4a87-8c5d-72fb6ea8c3d4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:47.283369 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-74b039cd-9a5e-4a87-8c5d-72fb6ea8c3d4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:47.289843 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-74b039cd-9a5e-4a87-8c5d-72fb6ea8c3d4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:47.292225 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-74b039cd-9a5e-4a87-8c5d-72fb6ea8c3d4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:47.292225 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-74b039cd-9a5e-4a87-8c5d-72fb6ea8c3d4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:47.292225 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-74b039cd-9a5e-4a87-8c5d-72fb6ea8c3d4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:47.362017 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-74b039cd-9a5e-4a87-8c5d-72fb6ea8c3d4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:47.371579 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-74b039cd-9a5e-4a87-8c5d-72fb6ea8c3d4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.093535 Jun 22 09:28:47.372161 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 830/1705] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:47 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:48.389722 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2afdacde-7c27-4d76-88bd-6dc8b5075f9b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:48.390334 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2afdacde-7c27-4d76-88bd-6dc8b5075f9b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:48.396900 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2afdacde-7c27-4d76-88bd-6dc8b5075f9b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:48.397351 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2afdacde-7c27-4d76-88bd-6dc8b5075f9b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:48.398140 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2afdacde-7c27-4d76-88bd-6dc8b5075f9b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:48.398584 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2afdacde-7c27-4d76-88bd-6dc8b5075f9b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:48.459807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-2afdacde-7c27-4d76-88bd-6dc8b5075f9b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:48.468439 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2afdacde-7c27-4d76-88bd-6dc8b5075f9b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082576 Jun 22 09:28:48.468970 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 876/1706] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:48 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:49.486466 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c8b934e0-9ea6-4e63-a8d3-6d2bdf2c3e49 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:49.487233 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c8b934e0-9ea6-4e63-a8d3-6d2bdf2c3e49 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:49.494894 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c8b934e0-9ea6-4e63-a8d3-6d2bdf2c3e49 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:49.495347 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c8b934e0-9ea6-4e63-a8d3-6d2bdf2c3e49 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:49.496137 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c8b934e0-9ea6-4e63-a8d3-6d2bdf2c3e49 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:49.496577 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c8b934e0-9ea6-4e63-a8d3-6d2bdf2c3e49 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:49.559333 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-c8b934e0-9ea6-4e63-a8d3-6d2bdf2c3e49 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:49.567318 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c8b934e0-9ea6-4e63-a8d3-6d2bdf2c3e49 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084900 Jun 22 09:28:49.567870 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 831/1707] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:49 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:50.584800 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-62d44bf2-9f57-4706-83f5-f22d134a0fb4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:50.585423 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-62d44bf2-9f57-4706-83f5-f22d134a0fb4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:50.592483 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-62d44bf2-9f57-4706-83f5-f22d134a0fb4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:50.593252 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-62d44bf2-9f57-4706-83f5-f22d134a0fb4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:50.594011 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-62d44bf2-9f57-4706-83f5-f22d134a0fb4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:50.594448 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-62d44bf2-9f57-4706-83f5-f22d134a0fb4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:50.658996 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-62d44bf2-9f57-4706-83f5-f22d134a0fb4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:50.667829 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-62d44bf2-9f57-4706-83f5-f22d134a0fb4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.086850 Jun 22 09:28:50.668410 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 877/1708] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:50 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:51.684810 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-84b5f57d-b186-4279-8518-35fbd1280daa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:51.685451 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-84b5f57d-b186-4279-8518-35fbd1280daa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:51.691920 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-84b5f57d-b186-4279-8518-35fbd1280daa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:51.692371 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-84b5f57d-b186-4279-8518-35fbd1280daa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:51.693172 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-84b5f57d-b186-4279-8518-35fbd1280daa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:51.693611 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-84b5f57d-b186-4279-8518-35fbd1280daa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:51.756692 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-84b5f57d-b186-4279-8518-35fbd1280daa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:51.765423 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-84b5f57d-b186-4279-8518-35fbd1280daa tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084653 Jun 22 09:28:51.765983 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 832/1709] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:51 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:52.782266 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-0875c663-39f3-445b-8947-9fe9434960f0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:52.782916 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-0875c663-39f3-445b-8947-9fe9434960f0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:52.789446 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0875c663-39f3-445b-8947-9fe9434960f0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:52.789895 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0875c663-39f3-445b-8947-9fe9434960f0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:52.790653 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0875c663-39f3-445b-8947-9fe9434960f0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:52.791090 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0875c663-39f3-445b-8947-9fe9434960f0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:52.851881 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-0875c663-39f3-445b-8947-9fe9434960f0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:52.860371 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-0875c663-39f3-445b-8947-9fe9434960f0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082075 Jun 22 09:28:52.860959 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 878/1710] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:52 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:53.877851 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-38ee8728-c35d-43a9-9cae-6747e24d2072 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:53.878398 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-38ee8728-c35d-43a9-9cae-6747e24d2072 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:53.884882 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-38ee8728-c35d-43a9-9cae-6747e24d2072 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:53.885464 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-38ee8728-c35d-43a9-9cae-6747e24d2072 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:53.886288 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-38ee8728-c35d-43a9-9cae-6747e24d2072 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:53.886825 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-38ee8728-c35d-43a9-9cae-6747e24d2072 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:53.948863 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-38ee8728-c35d-43a9-9cae-6747e24d2072 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:53.956876 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-38ee8728-c35d-43a9-9cae-6747e24d2072 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083314 Jun 22 09:28:53.957431 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 833/1711] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:53 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:54.974455 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-83e12eaa-e135-4d8e-82b1-3804e447a184 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:54.975061 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-83e12eaa-e135-4d8e-82b1-3804e447a184 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:54.982419 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-83e12eaa-e135-4d8e-82b1-3804e447a184 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:54.982863 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-83e12eaa-e135-4d8e-82b1-3804e447a184 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:54.983615 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-83e12eaa-e135-4d8e-82b1-3804e447a184 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:54.984172 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-83e12eaa-e135-4d8e-82b1-3804e447a184 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:55.053857 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-83e12eaa-e135-4d8e-82b1-3804e447a184 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:55.062794 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-83e12eaa-e135-4d8e-82b1-3804e447a184 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.092272 Jun 22 09:28:55.063357 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 879/1712] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:54 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:56.080156 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-91813a42-b27b-4eb0-b413-f98b898fde3f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:56.080767 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-91813a42-b27b-4eb0-b413-f98b898fde3f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:56.087336 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-91813a42-b27b-4eb0-b413-f98b898fde3f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:56.087783 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-91813a42-b27b-4eb0-b413-f98b898fde3f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:56.088549 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-91813a42-b27b-4eb0-b413-f98b898fde3f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:56.089014 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-91813a42-b27b-4eb0-b413-f98b898fde3f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:56.151640 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-91813a42-b27b-4eb0-b413-f98b898fde3f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:56.159519 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-91813a42-b27b-4eb0-b413-f98b898fde3f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083225 Jun 22 09:28:56.160072 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 834/1713] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:56 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:57.175871 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-6d45dc1d-dc19-4038-8c82-ed0d1574fc33 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:57.176486 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-6d45dc1d-dc19-4038-8c82-ed0d1574fc33 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:57.183019 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6d45dc1d-dc19-4038-8c82-ed0d1574fc33 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:57.183468 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6d45dc1d-dc19-4038-8c82-ed0d1574fc33 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:57.184224 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6d45dc1d-dc19-4038-8c82-ed0d1574fc33 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:57.184664 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6d45dc1d-dc19-4038-8c82-ed0d1574fc33 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:57.247568 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-6d45dc1d-dc19-4038-8c82-ed0d1574fc33 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:57.255437 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-6d45dc1d-dc19-4038-8c82-ed0d1574fc33 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083469 Jun 22 09:28:57.256002 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 880/1714] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:57 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:58.273257 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f3fdb3e7-d257-40b0-b0ce-31c9e227b9df tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:58.273871 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f3fdb3e7-d257-40b0-b0ce-31c9e227b9df tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:58.280901 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f3fdb3e7-d257-40b0-b0ce-31c9e227b9df tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:58.281353 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f3fdb3e7-d257-40b0-b0ce-31c9e227b9df tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:58.282114 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f3fdb3e7-d257-40b0-b0ce-31c9e227b9df tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:58.282554 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f3fdb3e7-d257-40b0-b0ce-31c9e227b9df tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:58.343718 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-f3fdb3e7-d257-40b0-b0ce-31c9e227b9df tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:58.351845 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f3fdb3e7-d257-40b0-b0ce-31c9e227b9df tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082537 Jun 22 09:28:58.352395 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 835/1715] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:58 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:28:59.369426 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-114a2bfa-4a46-4669-9023-6a705901ab6b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:28:59.370654 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-114a2bfa-4a46-4669-9023-6a705901ab6b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:28:59.377154 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-114a2bfa-4a46-4669-9023-6a705901ab6b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:59.377607 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-114a2bfa-4a46-4669-9023-6a705901ab6b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:59.378371 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-114a2bfa-4a46-4669-9023-6a705901ab6b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:28:59.378809 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-114a2bfa-4a46-4669-9023-6a705901ab6b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:28:59.442550 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-114a2bfa-4a46-4669-9023-6a705901ab6b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:28:59.450894 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-114a2bfa-4a46-4669-9023-6a705901ab6b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.085322 Jun 22 09:28:59.451451 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 881/1716] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:28:59 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:00.467705 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-86a99129-898c-4e22-a9eb-e114197ad7de tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:00.468246 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-86a99129-898c-4e22-a9eb-e114197ad7de tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:00.474786 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-86a99129-898c-4e22-a9eb-e114197ad7de tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:00.475241 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-86a99129-898c-4e22-a9eb-e114197ad7de tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:00.476011 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-86a99129-898c-4e22-a9eb-e114197ad7de tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:00.476456 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-86a99129-898c-4e22-a9eb-e114197ad7de tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:00.542123 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-86a99129-898c-4e22-a9eb-e114197ad7de tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:00.549997 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-86a99129-898c-4e22-a9eb-e114197ad7de tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.086437 Jun 22 09:29:00.550557 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 836/1717] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:00 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:01.567508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-16da9ca0-45d6-4660-8d7b-e26aa66f5ba7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:01.568126 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-16da9ca0-45d6-4660-8d7b-e26aa66f5ba7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:01.575072 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-16da9ca0-45d6-4660-8d7b-e26aa66f5ba7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:01.575519 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-16da9ca0-45d6-4660-8d7b-e26aa66f5ba7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:01.576276 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-16da9ca0-45d6-4660-8d7b-e26aa66f5ba7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:01.576966 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-16da9ca0-45d6-4660-8d7b-e26aa66f5ba7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:01.638305 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-16da9ca0-45d6-4660-8d7b-e26aa66f5ba7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:01.646196 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-16da9ca0-45d6-4660-8d7b-e26aa66f5ba7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082544 Jun 22 09:29:01.646750 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 882/1718] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:01 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:02.663629 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a6a89205-2099-4528-b806-7867ba7a257b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:02.664239 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a6a89205-2099-4528-b806-7867ba7a257b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:02.671486 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a6a89205-2099-4528-b806-7867ba7a257b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:02.671934 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a6a89205-2099-4528-b806-7867ba7a257b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:02.672700 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a6a89205-2099-4528-b806-7867ba7a257b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:02.673166 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a6a89205-2099-4528-b806-7867ba7a257b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:02.677124 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=84 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:29:02.734834 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-a6a89205-2099-4528-b806-7867ba7a257b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:02.742920 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a6a89205-2099-4528-b806-7867ba7a257b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083174 Jun 22 09:29:02.743479 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 837/1719] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:02 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:03.760212 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-fc518d55-f861-47d1-bf49-e05cd597fbd1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:03.763545 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-fc518d55-f861-47d1-bf49-e05cd597fbd1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:03.768045 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fc518d55-f861-47d1-bf49-e05cd597fbd1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:03.768490 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fc518d55-f861-47d1-bf49-e05cd597fbd1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:03.769273 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fc518d55-f861-47d1-bf49-e05cd597fbd1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:03.769751 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fc518d55-f861-47d1-bf49-e05cd597fbd1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:03.830439 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-fc518d55-f861-47d1-bf49-e05cd597fbd1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:03.838416 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-fc518d55-f861-47d1-bf49-e05cd597fbd1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082042 Jun 22 09:29:03.839721 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 883/1720] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:03 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:04.857259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-de764b65-415e-4e1b-ba04-1b6ed097d085 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:04.857873 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-de764b65-415e-4e1b-ba04-1b6ed097d085 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:04.865089 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-de764b65-415e-4e1b-ba04-1b6ed097d085 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:04.865544 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-de764b65-415e-4e1b-ba04-1b6ed097d085 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:04.866309 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-de764b65-415e-4e1b-ba04-1b6ed097d085 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:04.866756 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-de764b65-415e-4e1b-ba04-1b6ed097d085 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:04.936604 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-de764b65-415e-4e1b-ba04-1b6ed097d085 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:04.944589 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-de764b65-415e-4e1b-ba04-1b6ed097d085 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.092264 Jun 22 09:29:04.945180 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 838/1721] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:04 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:05.961615 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-eb01a5a6-b36c-4b54-8ef0-8ca1c8ed92c4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:05.962197 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-eb01a5a6-b36c-4b54-8ef0-8ca1c8ed92c4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:05.969041 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eb01a5a6-b36c-4b54-8ef0-8ca1c8ed92c4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:05.969494 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eb01a5a6-b36c-4b54-8ef0-8ca1c8ed92c4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:05.970254 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eb01a5a6-b36c-4b54-8ef0-8ca1c8ed92c4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:05.970696 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eb01a5a6-b36c-4b54-8ef0-8ca1c8ed92c4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:06.032043 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-eb01a5a6-b36c-4b54-8ef0-8ca1c8ed92c4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:06.039928 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-eb01a5a6-b36c-4b54-8ef0-8ca1c8ed92c4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082258 Jun 22 09:29:06.040485 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 884/1722] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:05 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:07.058196 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b807c494-1e40-4fe3-8d4a-c67ea73a5e31 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:07.059000 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-b807c494-1e40-4fe3-8d4a-c67ea73a5e31 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:07.065618 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b807c494-1e40-4fe3-8d4a-c67ea73a5e31 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:07.066067 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b807c494-1e40-4fe3-8d4a-c67ea73a5e31 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:07.066832 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b807c494-1e40-4fe3-8d4a-c67ea73a5e31 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:07.067272 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b807c494-1e40-4fe3-8d4a-c67ea73a5e31 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:07.128945 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-b807c494-1e40-4fe3-8d4a-c67ea73a5e31 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:07.137722 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-b807c494-1e40-4fe3-8d4a-c67ea73a5e31 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084074 Jun 22 09:29:07.138282 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 839/1723] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:07 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:08.155676 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-ddfab998-83ff-483b-9adb-78989ca2974d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:08.156281 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-ddfab998-83ff-483b-9adb-78989ca2974d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:08.158612 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=28 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:29:08.163375 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ddfab998-83ff-483b-9adb-78989ca2974d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:08.163817 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ddfab998-83ff-483b-9adb-78989ca2974d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:08.164572 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ddfab998-83ff-483b-9adb-78989ca2974d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:08.165030 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ddfab998-83ff-483b-9adb-78989ca2974d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:08.228664 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-ddfab998-83ff-483b-9adb-78989ca2974d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:08.237135 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-ddfab998-83ff-483b-9adb-78989ca2974d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.085938 Jun 22 09:29:08.237694 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 885/1724] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:08 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:09.254462 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-24ffce8f-d6ce-4299-935d-979b158a8369 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:09.255063 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-24ffce8f-d6ce-4299-935d-979b158a8369 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:09.261147 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-24ffce8f-d6ce-4299-935d-979b158a8369 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:09.261595 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-24ffce8f-d6ce-4299-935d-979b158a8369 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:09.262350 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-24ffce8f-d6ce-4299-935d-979b158a8369 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:09.262784 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-24ffce8f-d6ce-4299-935d-979b158a8369 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:09.325612 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-24ffce8f-d6ce-4299-935d-979b158a8369 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:09.333598 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-24ffce8f-d6ce-4299-935d-979b158a8369 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083175 Jun 22 09:29:09.334151 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 840/1725] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:09 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:10.351011 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d20a2378-eab4-4a33-94a1-c645d4f6c5c2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:10.351629 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-d20a2378-eab4-4a33-94a1-c645d4f6c5c2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:10.361362 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d20a2378-eab4-4a33-94a1-c645d4f6c5c2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:10.361824 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d20a2378-eab4-4a33-94a1-c645d4f6c5c2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:10.362806 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d20a2378-eab4-4a33-94a1-c645d4f6c5c2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:10.363044 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d20a2378-eab4-4a33-94a1-c645d4f6c5c2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:10.367021 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=84 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:29:10.425809 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-d20a2378-eab4-4a33-94a1-c645d4f6c5c2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:10.433796 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d20a2378-eab4-4a33-94a1-c645d4f6c5c2 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.086541 Jun 22 09:29:10.434161 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 886/1726] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:10 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:11.450713 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-66926c5e-64ad-4aee-b3a8-5c75891bde12 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:11.451332 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-66926c5e-64ad-4aee-b3a8-5c75891bde12 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:11.453765 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=30 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:29:11.458494 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-66926c5e-64ad-4aee-b3a8-5c75891bde12 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:11.458937 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-66926c5e-64ad-4aee-b3a8-5c75891bde12 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:11.459705 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-66926c5e-64ad-4aee-b3a8-5c75891bde12 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:11.460146 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-66926c5e-64ad-4aee-b3a8-5c75891bde12 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:11.521438 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-66926c5e-64ad-4aee-b3a8-5c75891bde12 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:11.530291 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-66926c5e-64ad-4aee-b3a8-5c75891bde12 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083712 Jun 22 09:29:11.530853 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 841/1727] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:11 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:12.546888 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-247b6dca-590f-40a8-8933-6347d9296316 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:12.547544 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-247b6dca-590f-40a8-8933-6347d9296316 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:12.553562 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-247b6dca-590f-40a8-8933-6347d9296316 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:12.554004 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-247b6dca-590f-40a8-8933-6347d9296316 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:12.554756 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-247b6dca-590f-40a8-8933-6347d9296316 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:12.555190 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-247b6dca-590f-40a8-8933-6347d9296316 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:12.615227 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-247b6dca-590f-40a8-8933-6347d9296316 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:12.623834 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-247b6dca-590f-40a8-8933-6347d9296316 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.080940 Jun 22 09:29:12.624387 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 887/1728] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:12 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:13.641482 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f6d45cba-116d-4f3c-b637-fd9c2a9c4974 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:13.642097 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f6d45cba-116d-4f3c-b637-fd9c2a9c4974 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:13.648751 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f6d45cba-116d-4f3c-b637-fd9c2a9c4974 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:13.649224 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f6d45cba-116d-4f3c-b637-fd9c2a9c4974 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:13.650037 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f6d45cba-116d-4f3c-b637-fd9c2a9c4974 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:13.650549 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f6d45cba-116d-4f3c-b637-fd9c2a9c4974 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:13.713710 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-f6d45cba-116d-4f3c-b637-fd9c2a9c4974 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:13.723251 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f6d45cba-116d-4f3c-b637-fd9c2a9c4974 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.085845 Jun 22 09:29:13.723821 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 842/1729] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:13 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:14.739662 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-907c7480-fecf-468e-aa7a-e784f4fb770e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:14.740201 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-907c7480-fecf-468e-aa7a-e784f4fb770e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:14.746816 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-907c7480-fecf-468e-aa7a-e784f4fb770e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:14.747363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-907c7480-fecf-468e-aa7a-e784f4fb770e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:14.748325 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-907c7480-fecf-468e-aa7a-e784f4fb770e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:14.748804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-907c7480-fecf-468e-aa7a-e784f4fb770e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:14.812750 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-907c7480-fecf-468e-aa7a-e784f4fb770e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:14.820615 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-907c7480-fecf-468e-aa7a-e784f4fb770e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.085137 Jun 22 09:29:14.821205 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 888/1730] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:14 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:15.837696 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ad21d599-7b9e-4e9a-92c5-35bc3f0833bc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:15.838314 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ad21d599-7b9e-4e9a-92c5-35bc3f0833bc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:15.845584 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ad21d599-7b9e-4e9a-92c5-35bc3f0833bc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:15.846038 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ad21d599-7b9e-4e9a-92c5-35bc3f0833bc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:15.846806 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ad21d599-7b9e-4e9a-92c5-35bc3f0833bc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:15.847250 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ad21d599-7b9e-4e9a-92c5-35bc3f0833bc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:15.909475 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ad21d599-7b9e-4e9a-92c5-35bc3f0833bc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:15.917437 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ad21d599-7b9e-4e9a-92c5-35bc3f0833bc tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083622 Jun 22 09:29:15.918003 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 843/1731] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:15 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:16.935832 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-eb65fd3d-1774-4cd2-8a04-1ae1549013e9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:16.936444 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-eb65fd3d-1774-4cd2-8a04-1ae1549013e9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:16.943093 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eb65fd3d-1774-4cd2-8a04-1ae1549013e9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:16.943540 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eb65fd3d-1774-4cd2-8a04-1ae1549013e9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:16.944296 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eb65fd3d-1774-4cd2-8a04-1ae1549013e9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:16.944734 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-eb65fd3d-1774-4cd2-8a04-1ae1549013e9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:17.006923 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-eb65fd3d-1774-4cd2-8a04-1ae1549013e9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:17.014964 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-eb65fd3d-1774-4cd2-8a04-1ae1549013e9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083107 Jun 22 09:29:17.015525 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 889/1732] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:16 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:18.032264 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-fc896789-5eca-4e2c-9edb-7da5404da734 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:18.032893 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-fc896789-5eca-4e2c-9edb-7da5404da734 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:18.039457 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fc896789-5eca-4e2c-9edb-7da5404da734 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:18.039907 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fc896789-5eca-4e2c-9edb-7da5404da734 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:18.040682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fc896789-5eca-4e2c-9edb-7da5404da734 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:18.041155 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-fc896789-5eca-4e2c-9edb-7da5404da734 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:18.104797 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-fc896789-5eca-4e2c-9edb-7da5404da734 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:18.113585 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-fc896789-5eca-4e2c-9edb-7da5404da734 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.085433 Jun 22 09:29:18.114136 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 844/1733] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:18 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:19.131161 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2db9eb50-4502-4c1f-bfbd-a82d4a2df58e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:19.131770 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2db9eb50-4502-4c1f-bfbd-a82d4a2df58e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:19.139441 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2db9eb50-4502-4c1f-bfbd-a82d4a2df58e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:19.139897 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2db9eb50-4502-4c1f-bfbd-a82d4a2df58e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:19.140656 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2db9eb50-4502-4c1f-bfbd-a82d4a2df58e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:19.141133 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2db9eb50-4502-4c1f-bfbd-a82d4a2df58e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:19.202121 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-2db9eb50-4502-4c1f-bfbd-a82d4a2df58e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:19.210190 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2db9eb50-4502-4c1f-bfbd-a82d4a2df58e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082908 Jun 22 09:29:19.210758 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 890/1734] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:19 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:20.227557 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-49e8769a-222d-4962-a654-3778957abe6e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:20.228164 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-49e8769a-222d-4962-a654-3778957abe6e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:20.234848 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-49e8769a-222d-4962-a654-3778957abe6e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:20.235289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-49e8769a-222d-4962-a654-3778957abe6e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:20.236288 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-49e8769a-222d-4962-a654-3778957abe6e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:20.236723 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-49e8769a-222d-4962-a654-3778957abe6e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:20.298216 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-49e8769a-222d-4962-a654-3778957abe6e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:20.306097 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-49e8769a-222d-4962-a654-3778957abe6e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082500 Jun 22 09:29:20.306781 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 845/1735] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:20 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:21.323947 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e09c7b43-8b75-4e4f-961e-ad5487095a7d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:21.324651 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e09c7b43-8b75-4e4f-961e-ad5487095a7d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:21.331530 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e09c7b43-8b75-4e4f-961e-ad5487095a7d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:21.331981 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e09c7b43-8b75-4e4f-961e-ad5487095a7d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:21.332803 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e09c7b43-8b75-4e4f-961e-ad5487095a7d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:21.333248 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e09c7b43-8b75-4e4f-961e-ad5487095a7d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:21.393807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-e09c7b43-8b75-4e4f-961e-ad5487095a7d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:21.401717 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e09c7b43-8b75-4e4f-961e-ad5487095a7d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082102 Jun 22 09:29:21.402269 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 891/1736] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:21 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:22.419971 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ea330612-d837-49a1-bcd8-a05f42b74772 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:22.420581 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ea330612-d837-49a1-bcd8-a05f42b74772 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:22.427014 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ea330612-d837-49a1-bcd8-a05f42b74772 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:22.427452 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ea330612-d837-49a1-bcd8-a05f42b74772 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:22.428220 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ea330612-d837-49a1-bcd8-a05f42b74772 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:22.428651 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ea330612-d837-49a1-bcd8-a05f42b74772 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:22.491739 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ea330612-d837-49a1-bcd8-a05f42b74772 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:22.500561 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ea330612-d837-49a1-bcd8-a05f42b74772 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.085241 Jun 22 09:29:22.501150 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 846/1737] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:22 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:23.516923 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-066054ed-b8ba-4d6c-9c77-219633d4ec0b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:23.517451 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-066054ed-b8ba-4d6c-9c77-219633d4ec0b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:23.523924 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-066054ed-b8ba-4d6c-9c77-219633d4ec0b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:23.524377 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-066054ed-b8ba-4d6c-9c77-219633d4ec0b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:23.525169 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-066054ed-b8ba-4d6c-9c77-219633d4ec0b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:23.525611 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-066054ed-b8ba-4d6c-9c77-219633d4ec0b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:23.584942 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-066054ed-b8ba-4d6c-9c77-219633d4ec0b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:23.593274 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-066054ed-b8ba-4d6c-9c77-219633d4ec0b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.080348 Jun 22 09:29:23.593840 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 892/1738] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:23 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:24.610751 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-147381e3-85b0-4073-91f1-9856de9854c9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:24.611419 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-147381e3-85b0-4073-91f1-9856de9854c9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:24.617891 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-147381e3-85b0-4073-91f1-9856de9854c9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:24.618338 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-147381e3-85b0-4073-91f1-9856de9854c9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:24.619100 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-147381e3-85b0-4073-91f1-9856de9854c9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:24.619535 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-147381e3-85b0-4073-91f1-9856de9854c9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:24.679626 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-147381e3-85b0-4073-91f1-9856de9854c9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:24.687685 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-147381e3-85b0-4073-91f1-9856de9854c9 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081939 Jun 22 09:29:24.688244 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 847/1739] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:24 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:25.704796 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-bd18ef26-5479-455f-b2d9-73e97563dff0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:25.705421 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-bd18ef26-5479-455f-b2d9-73e97563dff0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:25.712002 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bd18ef26-5479-455f-b2d9-73e97563dff0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:25.712437 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bd18ef26-5479-455f-b2d9-73e97563dff0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:25.713249 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bd18ef26-5479-455f-b2d9-73e97563dff0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:25.713692 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bd18ef26-5479-455f-b2d9-73e97563dff0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:25.774235 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-bd18ef26-5479-455f-b2d9-73e97563dff0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:25.785074 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-bd18ef26-5479-455f-b2d9-73e97563dff0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084187 Jun 22 09:29:25.785647 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 893/1740] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:25 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:26.803071 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-4e49e954-66eb-41fb-a33e-ca74bdc5d36c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:26.803678 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-4e49e954-66eb-41fb-a33e-ca74bdc5d36c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:26.810088 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4e49e954-66eb-41fb-a33e-ca74bdc5d36c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:26.810636 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4e49e954-66eb-41fb-a33e-ca74bdc5d36c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:26.811401 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4e49e954-66eb-41fb-a33e-ca74bdc5d36c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:26.811838 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4e49e954-66eb-41fb-a33e-ca74bdc5d36c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:26.875882 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-4e49e954-66eb-41fb-a33e-ca74bdc5d36c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:26.883904 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-4e49e954-66eb-41fb-a33e-ca74bdc5d36c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084719 Jun 22 09:29:26.884453 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 848/1741] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:26 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:27.901757 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-6653c1e2-9402-4f5d-8608-218c8a40e851 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:27.902333 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-6653c1e2-9402-4f5d-8608-218c8a40e851 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:27.910426 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6653c1e2-9402-4f5d-8608-218c8a40e851 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:27.911245 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6653c1e2-9402-4f5d-8608-218c8a40e851 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:27.912518 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6653c1e2-9402-4f5d-8608-218c8a40e851 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:27.913272 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6653c1e2-9402-4f5d-8608-218c8a40e851 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:27.975857 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-6653c1e2-9402-4f5d-8608-218c8a40e851 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:27.984432 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-6653c1e2-9402-4f5d-8608-218c8a40e851 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.086662 Jun 22 09:29:27.985274 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 894/1742] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:27 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:29.002494 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3900afbd-870a-4cc1-8c5f-f718a3fa1f64 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:29.003232 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3900afbd-870a-4cc1-8c5f-f718a3fa1f64 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:29.009884 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3900afbd-870a-4cc1-8c5f-f718a3fa1f64 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:29.010334 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3900afbd-870a-4cc1-8c5f-f718a3fa1f64 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:29.011085 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3900afbd-870a-4cc1-8c5f-f718a3fa1f64 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:29.011518 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3900afbd-870a-4cc1-8c5f-f718a3fa1f64 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:29.074831 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3900afbd-870a-4cc1-8c5f-f718a3fa1f64 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:29.083352 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3900afbd-870a-4cc1-8c5f-f718a3fa1f64 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.085503 Jun 22 09:29:29.083919 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 849/1743] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:28 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:30.099367 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-8755a3d2-90c6-4474-8b0a-a0ee0cd7b19f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:30.099978 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-8755a3d2-90c6-4474-8b0a-a0ee0cd7b19f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:30.106479 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8755a3d2-90c6-4474-8b0a-a0ee0cd7b19f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:30.106999 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8755a3d2-90c6-4474-8b0a-a0ee0cd7b19f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:30.107904 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8755a3d2-90c6-4474-8b0a-a0ee0cd7b19f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:30.108339 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8755a3d2-90c6-4474-8b0a-a0ee0cd7b19f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:30.171748 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-8755a3d2-90c6-4474-8b0a-a0ee0cd7b19f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:30.180233 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-8755a3d2-90c6-4474-8b0a-a0ee0cd7b19f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084752 Jun 22 09:29:30.180799 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 895/1744] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:30 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:31.196811 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-648dc422-e35a-445f-ab48-183ce204d05b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:31.197417 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-648dc422-e35a-445f-ab48-183ce204d05b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:31.203984 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-648dc422-e35a-445f-ab48-183ce204d05b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:31.204514 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-648dc422-e35a-445f-ab48-183ce204d05b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:31.205329 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-648dc422-e35a-445f-ab48-183ce204d05b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:31.205771 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-648dc422-e35a-445f-ab48-183ce204d05b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:31.270538 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-648dc422-e35a-445f-ab48-183ce204d05b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:31.279568 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-648dc422-e35a-445f-ab48-183ce204d05b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.086132 Jun 22 09:29:31.280236 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 850/1745] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:31 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:32.297115 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-4d5b1782-fd11-4d9d-a595-d08145093ffd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:32.297757 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-4d5b1782-fd11-4d9d-a595-d08145093ffd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:32.304108 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4d5b1782-fd11-4d9d-a595-d08145093ffd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:32.304555 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4d5b1782-fd11-4d9d-a595-d08145093ffd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:32.305333 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4d5b1782-fd11-4d9d-a595-d08145093ffd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:32.305776 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4d5b1782-fd11-4d9d-a595-d08145093ffd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:32.367490 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-4d5b1782-fd11-4d9d-a595-d08145093ffd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:32.376196 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-4d5b1782-fd11-4d9d-a595-d08145093ffd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083441 Jun 22 09:29:32.376756 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 896/1746] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:32 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:33.393096 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-df9ff448-85e8-4282-bf56-53c453f3dac1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:33.393714 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-df9ff448-85e8-4282-bf56-53c453f3dac1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:33.400156 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-df9ff448-85e8-4282-bf56-53c453f3dac1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:33.400611 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-df9ff448-85e8-4282-bf56-53c453f3dac1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:33.401408 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-df9ff448-85e8-4282-bf56-53c453f3dac1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:33.401850 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-df9ff448-85e8-4282-bf56-53c453f3dac1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:33.462834 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-df9ff448-85e8-4282-bf56-53c453f3dac1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:33.471550 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-df9ff448-85e8-4282-bf56-53c453f3dac1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.082309 Jun 22 09:29:33.472024 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 851/1747] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:33 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:34.395240 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:29:34.395805 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Wed Jun 22 09:29:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:29:34.488384 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c50fe6d4-49ac-4d1f-9f4a-f11b918ea08a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:34.488986 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c50fe6d4-49ac-4d1f-9f4a-f11b918ea08a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:34.495590 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c50fe6d4-49ac-4d1f-9f4a-f11b918ea08a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:34.496062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c50fe6d4-49ac-4d1f-9f4a-f11b918ea08a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:34.496846 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c50fe6d4-49ac-4d1f-9f4a-f11b918ea08a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:34.497949 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c50fe6d4-49ac-4d1f-9f4a-f11b918ea08a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:34.556824 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c50fe6d4-49ac-4d1f-9f4a-f11b918ea08a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:34.565293 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c50fe6d4-49ac-4d1f-9f4a-f11b918ea08a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081256 Jun 22 09:29:34.565856 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 897/1748] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:34 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:35.582671 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-66b4adb5-81e2-4a4a-858b-3aa7a1f2def7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:35.583294 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-66b4adb5-81e2-4a4a-858b-3aa7a1f2def7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:35.589841 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-66b4adb5-81e2-4a4a-858b-3aa7a1f2def7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:35.590300 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-66b4adb5-81e2-4a4a-858b-3aa7a1f2def7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:35.591185 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-66b4adb5-81e2-4a4a-858b-3aa7a1f2def7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:35.591626 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-66b4adb5-81e2-4a4a-858b-3aa7a1f2def7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:35.594201 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=90 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:29:35.655683 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-66b4adb5-81e2-4a4a-858b-3aa7a1f2def7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:35.663679 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-66b4adb5-81e2-4a4a-858b-3aa7a1f2def7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084909 Jun 22 09:29:35.664232 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 852/1749] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:35 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:36.680722 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-96e4ac41-153a-4f4d-b26d-57de279e40df tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:36.681365 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-96e4ac41-153a-4f4d-b26d-57de279e40df tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:36.687939 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-96e4ac41-153a-4f4d-b26d-57de279e40df tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:36.688382 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-96e4ac41-153a-4f4d-b26d-57de279e40df tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:36.689172 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-96e4ac41-153a-4f4d-b26d-57de279e40df tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:36.689606 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-96e4ac41-153a-4f4d-b26d-57de279e40df tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:36.750274 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-96e4ac41-153a-4f4d-b26d-57de279e40df tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:36.758225 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-96e4ac41-153a-4f4d-b26d-57de279e40df tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081515 Jun 22 09:29:36.758789 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 898/1750] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:36 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:37.775441 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-adfe0716-1d99-4c0b-a9a4-e9dc35066d83 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:37.776065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-adfe0716-1d99-4c0b-a9a4-e9dc35066d83 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:37.783251 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-adfe0716-1d99-4c0b-a9a4-e9dc35066d83 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:37.783704 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-adfe0716-1d99-4c0b-a9a4-e9dc35066d83 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:37.784467 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-adfe0716-1d99-4c0b-a9a4-e9dc35066d83 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:37.784941 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-adfe0716-1d99-4c0b-a9a4-e9dc35066d83 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:37.847996 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-adfe0716-1d99-4c0b-a9a4-e9dc35066d83 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:37.855979 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-adfe0716-1d99-4c0b-a9a4-e9dc35066d83 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084430 Jun 22 09:29:37.856529 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 853/1751] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:37 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:38.877185 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d227886a-9d4e-4c66-a322-53ff9c90032a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:38.877820 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-d227886a-9d4e-4c66-a322-53ff9c90032a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:38.880207 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=28 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:29:38.884984 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d227886a-9d4e-4c66-a322-53ff9c90032a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:38.885433 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d227886a-9d4e-4c66-a322-53ff9c90032a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:38.886191 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d227886a-9d4e-4c66-a322-53ff9c90032a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:38.886668 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d227886a-9d4e-4c66-a322-53ff9c90032a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:38.947914 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-d227886a-9d4e-4c66-a322-53ff9c90032a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:38.956259 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d227886a-9d4e-4c66-a322-53ff9c90032a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083047 Jun 22 09:29:38.956825 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 899/1752] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:38 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:39.974151 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a152c6bf-0b71-4c64-9cad-e7dac1e316b7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:39.974661 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a152c6bf-0b71-4c64-9cad-e7dac1e316b7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:39.981004 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a152c6bf-0b71-4c64-9cad-e7dac1e316b7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:39.981452 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a152c6bf-0b71-4c64-9cad-e7dac1e316b7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:39.982232 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a152c6bf-0b71-4c64-9cad-e7dac1e316b7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:39.982666 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a152c6bf-0b71-4c64-9cad-e7dac1e316b7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:40.047103 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-a152c6bf-0b71-4c64-9cad-e7dac1e316b7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:40.055037 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a152c6bf-0b71-4c64-9cad-e7dac1e316b7 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084826 Jun 22 09:29:40.055593 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 854/1753] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:39 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:41.072723 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a8b99c06-1091-4938-b2b4-8854132966ec tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:41.073363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-a8b99c06-1091-4938-b2b4-8854132966ec tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:41.079780 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a8b99c06-1091-4938-b2b4-8854132966ec tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:41.080233 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a8b99c06-1091-4938-b2b4-8854132966ec tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:41.081019 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a8b99c06-1091-4938-b2b4-8854132966ec tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:41.081458 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a8b99c06-1091-4938-b2b4-8854132966ec tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:41.085379 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=84 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:29:41.142588 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-a8b99c06-1091-4938-b2b4-8854132966ec tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:41.150519 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a8b99c06-1091-4938-b2b4-8854132966ec tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081845 Jun 22 09:29:41.151078 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 900/1754] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:41 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:42.167530 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-51b158a5-2106-4b82-a1d2-d4ef29e3331e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:42.168139 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-51b158a5-2106-4b82-a1d2-d4ef29e3331e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:42.170496 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=28 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:29:42.175498 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-51b158a5-2106-4b82-a1d2-d4ef29e3331e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:42.175952 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-51b158a5-2106-4b82-a1d2-d4ef29e3331e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:42.176715 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-51b158a5-2106-4b82-a1d2-d4ef29e3331e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:42.177186 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-51b158a5-2106-4b82-a1d2-d4ef29e3331e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:42.239640 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-51b158a5-2106-4b82-a1d2-d4ef29e3331e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:42.247620 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-51b158a5-2106-4b82-a1d2-d4ef29e3331e tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.084077 Jun 22 09:29:42.248179 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 855/1755] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:42 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:43.264745 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a22ffbcc-2971-4400-8aa8-fcc6b1cb6fe0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:43.265386 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-a22ffbcc-2971-4400-8aa8-fcc6b1cb6fe0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:43.272617 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a22ffbcc-2971-4400-8aa8-fcc6b1cb6fe0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:43.273108 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a22ffbcc-2971-4400-8aa8-fcc6b1cb6fe0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:43.273871 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a22ffbcc-2971-4400-8aa8-fcc6b1cb6fe0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:43.274310 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a22ffbcc-2971-4400-8aa8-fcc6b1cb6fe0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:43.336031 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-a22ffbcc-2971-4400-8aa8-fcc6b1cb6fe0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:43.343940 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a22ffbcc-2971-4400-8aa8-fcc6b1cb6fe0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083058 Jun 22 09:29:43.344496 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 901/1756] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:43 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:44.361713 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3fbc0230-a1ad-418e-8530-f733caf96ce0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:44.362248 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3fbc0230-a1ad-418e-8530-f733caf96ce0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:44.368705 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3fbc0230-a1ad-418e-8530-f733caf96ce0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:44.369189 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3fbc0230-a1ad-418e-8530-f733caf96ce0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:44.369959 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3fbc0230-a1ad-418e-8530-f733caf96ce0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:44.370395 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3fbc0230-a1ad-418e-8530-f733caf96ce0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:44.437784 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3fbc0230-a1ad-418e-8530-f733caf96ce0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:44.447191 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3fbc0230-a1ad-418e-8530-f733caf96ce0 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.090122 Jun 22 09:29:44.447768 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 856/1757] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:44 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:45.464581 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-b48cc908-1ffb-4941-bbfb-e41ee57ad7ea tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:45.465115 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-b48cc908-1ffb-4941-bbfb-e41ee57ad7ea tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:45.474948 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b48cc908-1ffb-4941-bbfb-e41ee57ad7ea tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:45.475415 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b48cc908-1ffb-4941-bbfb-e41ee57ad7ea tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:45.476210 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b48cc908-1ffb-4941-bbfb-e41ee57ad7ea tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:45.476667 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b48cc908-1ffb-4941-bbfb-e41ee57ad7ea tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:45.689681 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-b48cc908-1ffb-4941-bbfb-e41ee57ad7ea tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:45.697589 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-b48cc908-1ffb-4941-bbfb-e41ee57ad7ea tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.236918 Jun 22 09:29:45.698144 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 902/1758] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:45 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:46.713855 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-73c3d5b6-a22d-45f5-b9d7-7091834c577f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:46.714496 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-73c3d5b6-a22d-45f5-b9d7-7091834c577f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:46.721431 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-73c3d5b6-a22d-45f5-b9d7-7091834c577f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:46.721883 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-73c3d5b6-a22d-45f5-b9d7-7091834c577f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:46.722644 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-73c3d5b6-a22d-45f5-b9d7-7091834c577f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:46.723083 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-73c3d5b6-a22d-45f5-b9d7-7091834c577f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:46.783716 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-73c3d5b6-a22d-45f5-b9d7-7091834c577f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:46.791592 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-73c3d5b6-a22d-45f5-b9d7-7091834c577f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081638 Jun 22 09:29:46.792146 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 857/1759] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:46 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:47.809114 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-ad41930a-0af2-46cc-b698-cddd709f591d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:47.809753 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-ad41930a-0af2-46cc-b698-cddd709f591d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:47.816730 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ad41930a-0af2-46cc-b698-cddd709f591d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:47.817213 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ad41930a-0af2-46cc-b698-cddd709f591d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:47.817973 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ad41930a-0af2-46cc-b698-cddd709f591d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:47.818410 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-ad41930a-0af2-46cc-b698-cddd709f591d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:47.878521 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-ad41930a-0af2-46cc-b698-cddd709f591d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:47.886419 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-ad41930a-0af2-46cc-b698-cddd709f591d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081182 Jun 22 09:29:47.886951 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 903/1760] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:47 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:48.904004 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3733e108-45b8-4b5c-8f3d-d77945dea8e3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:48.904612 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3733e108-45b8-4b5c-8f3d-d77945dea8e3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:48.911102 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3733e108-45b8-4b5c-8f3d-d77945dea8e3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:48.911542 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3733e108-45b8-4b5c-8f3d-d77945dea8e3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:48.912296 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3733e108-45b8-4b5c-8f3d-d77945dea8e3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:48.912735 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3733e108-45b8-4b5c-8f3d-d77945dea8e3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:48.982871 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3733e108-45b8-4b5c-8f3d-d77945dea8e3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:48.995464 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3733e108-45b8-4b5c-8f3d-d77945dea8e3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.095323 Jun 22 09:29:48.996038 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 858/1761] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:48 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:50.013324 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-5e121a50-5e50-4a7c-a0d0-f73b4084f57f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:50.013860 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-5e121a50-5e50-4a7c-a0d0-f73b4084f57f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:50.021135 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5e121a50-5e50-4a7c-a0d0-f73b4084f57f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:50.021589 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5e121a50-5e50-4a7c-a0d0-f73b4084f57f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:50.022362 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5e121a50-5e50-4a7c-a0d0-f73b4084f57f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:50.022807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5e121a50-5e50-4a7c-a0d0-f73b4084f57f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:50.083098 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-5e121a50-5e50-4a7c-a0d0-f73b4084f57f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:50.091049 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-5e121a50-5e50-4a7c-a0d0-f73b4084f57f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081734 Jun 22 09:29:50.091604 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 904/1762] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:50 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:51.108648 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f0c8c4a5-3786-427a-81ec-7825ee7aad46 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:51.109544 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f0c8c4a5-3786-427a-81ec-7825ee7aad46 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:51.117283 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f0c8c4a5-3786-427a-81ec-7825ee7aad46 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:51.117742 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f0c8c4a5-3786-427a-81ec-7825ee7aad46 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:51.118514 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f0c8c4a5-3786-427a-81ec-7825ee7aad46 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:51.118956 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f0c8c4a5-3786-427a-81ec-7825ee7aad46 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:51.179877 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-f0c8c4a5-3786-427a-81ec-7825ee7aad46 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:51.187865 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f0c8c4a5-3786-427a-81ec-7825ee7aad46 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.083130 Jun 22 09:29:51.189583 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 859/1763] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:51 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:52.206427 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-157bb06b-40a4-4f90-8a11-eb1862c10a71 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:52.207037 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-157bb06b-40a4-4f90-8a11-eb1862c10a71 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:52.213643 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-157bb06b-40a4-4f90-8a11-eb1862c10a71 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:52.214094 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-157bb06b-40a4-4f90-8a11-eb1862c10a71 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:52.214860 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-157bb06b-40a4-4f90-8a11-eb1862c10a71 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:52.215296 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-157bb06b-40a4-4f90-8a11-eb1862c10a71 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:52.276016 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-157bb06b-40a4-4f90-8a11-eb1862c10a71 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:52.283923 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-157bb06b-40a4-4f90-8a11-eb1862c10a71 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081904 Jun 22 09:29:52.284464 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 905/1764] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:52 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:53.300833 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c61decf8-2a54-4bcf-a080-5d0df4c48665 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:53.301444 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c61decf8-2a54-4bcf-a080-5d0df4c48665 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:53.307915 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c61decf8-2a54-4bcf-a080-5d0df4c48665 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:53.308367 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c61decf8-2a54-4bcf-a080-5d0df4c48665 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:53.309218 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c61decf8-2a54-4bcf-a080-5d0df4c48665 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:53.309655 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c61decf8-2a54-4bcf-a080-5d0df4c48665 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:53.378670 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-c61decf8-2a54-4bcf-a080-5d0df4c48665 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:53.386929 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c61decf8-2a54-4bcf-a080-5d0df4c48665 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.090744 Jun 22 09:29:53.387496 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 860/1765] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:53 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:54.404128 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-5d0c731c-96e2-4f94-86fc-75e498e5586d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:54.404737 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-5d0c731c-96e2-4f94-86fc-75e498e5586d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:54.411212 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5d0c731c-96e2-4f94-86fc-75e498e5586d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:54.411654 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5d0c731c-96e2-4f94-86fc-75e498e5586d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:54.412404 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5d0c731c-96e2-4f94-86fc-75e498e5586d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:54.412866 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-5d0c731c-96e2-4f94-86fc-75e498e5586d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:54.473621 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-5d0c731c-96e2-4f94-86fc-75e498e5586d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:54.481488 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-5d0c731c-96e2-4f94-86fc-75e498e5586d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081250 Jun 22 09:29:54.482036 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 906/1766] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:54 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:55.499748 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1ea4a016-80bb-4ae5-b607-2f9430ece433 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:55.500305 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1ea4a016-80bb-4ae5-b607-2f9430ece433 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:55.507262 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1ea4a016-80bb-4ae5-b607-2f9430ece433 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:55.507710 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1ea4a016-80bb-4ae5-b607-2f9430ece433 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:55.508465 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1ea4a016-80bb-4ae5-b607-2f9430ece433 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:55.508928 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1ea4a016-80bb-4ae5-b607-2f9430ece433 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:55.569499 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-1ea4a016-80bb-4ae5-b607-2f9430ece433 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:55.577344 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1ea4a016-80bb-4ae5-b607-2f9430ece433 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081565 Jun 22 09:29:55.577906 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 861/1767] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:55 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:56.594965 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-b4603038-3a92-48ff-b6f2-48a94e53dfef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:56.595642 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-b4603038-3a92-48ff-b6f2-48a94e53dfef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:29:56.602126 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b4603038-3a92-48ff-b6f2-48a94e53dfef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:56.602578 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b4603038-3a92-48ff-b6f2-48a94e53dfef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:56.603339 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b4603038-3a92-48ff-b6f2-48a94e53dfef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:29:56.603777 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b4603038-3a92-48ff-b6f2-48a94e53dfef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:29:56.663905 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-b4603038-3a92-48ff-b6f2-48a94e53dfef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:29:56.671861 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-b4603038-3a92-48ff-b6f2-48a94e53dfef tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 200 len: 1369 microversion: 2.1 time: 0.081464 Jun 22 09:29:56.672809 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 907/1768] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:29:56 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:29:56.689087 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-d528a03f-9175-47ea-9a6f-b160c072d231 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '.version_select at 0x7f5756c84040>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:29:56.782974 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-d528a03f-9175-47ea-9a6f-b160c072d231 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1306165953" status: 202 len: 0 microversion: 2.1 time: 0.097761 Jun 22 09:29:56.783549 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 862/1769] 10.222.0.16 () {58 vars in 1220 bytes} [Wed Jun 22 09:29:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1306165953 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:29:57.132291 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:29:57.132481 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Wed Jun 22 09:29:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:29:57.834910 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-171d58bb-b773-46e9-b2e4-a7325dee6ff8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Action: 'create', calling method: .version_select at 0x7f5756054430>, body: {"keypair": {"name": "tempest-keypair-315021321", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDcImX/TcX6x7cu2J0vRlBb65jof9LpOoUkIPJEKf/mRh2UU3JNFv5q3QLYzzzdeIj4dpgZbbDasryM/yfkoimmAp1QFui0sDTna8fhRS7WcBgJHXQiAhnOwBLiltpcEaQ=="}} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:29:57.850338 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.quota [None req-171d58bb-b773-46e9-b2e4-a7325dee6ff8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Getting quotas for project 175a336dc3fd44c2ae20e51b46d423e4. Resources: {'key_pairs'} {{(pid=118025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:29:57.854461 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.quota [None req-171d58bb-b773-46e9-b2e4-a7325dee6ff8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Getting quotas for user 566b001b7a504fadb85ad04ea1be22f2 and project 175a336dc3fd44c2ae20e51b46d423e4. Resources: {'key_pairs'} {{(pid=118025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:29:57.951863 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-171d58bb-b773-46e9-b2e4-a7325dee6ff8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.120825 Jun 22 09:29:57.952461 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 908/1770] 10.222.0.16 () {60 vars in 1158 bytes} [Wed Jun 22 09:29:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:30:00.251051 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-91142eeb-e91f-4470-86f3-83241a101006 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-167245110", "imageRef": "c24d36a8-7909-4174-9b12-42c8d76647ac", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a75772f1-9e0a-482d-85cb-39939e4ffc1e"}], "security_groups": [{"name": "tempest-securitygroup--28369054"}], "key_name": "tempest-keypair-315021321", "user_data": "}} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:30:00.301866 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-bf869eff-a6c5-4bb8-99f5-8a646ca25272 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:30:00.302886 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-bf869eff-a6c5-4bb8-99f5-8a646ca25272 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:30:00.338471 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bf869eff-a6c5-4bb8-99f5-8a646ca25272 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:00.339202 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bf869eff-a6c5-4bb8-99f5-8a646ca25272 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:00.340144 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bf869eff-a6c5-4bb8-99f5-8a646ca25272 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:00.340587 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bf869eff-a6c5-4bb8-99f5-8a646ca25272 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:00.355913 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.wsgi [None req-bf869eff-a6c5-4bb8-99f5-8a646ca25272 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] HTTP exception thrown: Instance dce83571-cd21-48a3-b54d-b6218f563363 could not be found. Jun 22 09:30:00.358062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-bf869eff-a6c5-4bb8-99f5-8a646ca25272 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Request method failure captured: Jun 22 09:30:00.358062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: request: DELETE /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 HTTP/1.1 Jun 22 09:30:00.358062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept: application/json Jun 22 09:30:00.358062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept-Encoding: identity Jun 22 09:30:00.358062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Connection: close Jun 22 09:30:00.358062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Length: 0 Jun 22 09:30:00.358062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Type: application/json Jun 22 09:30:00.358062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Host: 10.222.0.16 Jun 22 09:30:00.358062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Openstack-System-Scope: None Jun 22 09:30:00.358062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: User-Agent: python-urllib3/1.26.9 Jun 22 09:30:00.358062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Auth-Token: gAAAAABistmshaECFGAHnRmYa6rYBXSOVD0Qua4uTG5avt1MhcK74DWY3z7j33DyNyPUEHkNAlpnveIdxiQXR4PVctEysp2-oZYhmBZfOkICvSxCioSV-tQOnSDfZ3AGE3xsfOtBMU0bgwdFz6BzWaVEfy2YGlGG8lqZlzBcaQ5nCEgZDL5ggws Jun 22 09:30:00.358062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Id: None Jun 22 09:30:00.358062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Name: None Jun 22 09:30:00.358062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Identity-Status: Confirmed Jun 22 09:30:00.358062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Is-Admin-Project: True Jun 22 09:30:00.358062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 09:30:00.358062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Id: default Jun 22 09:30:00.358062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Name: Default Jun 22 09:30:00.358062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Id: b172c496b3304444bd6169a09cff85d2 Jun 22 09:30:00.358062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2111643669 Jun 22 09:30:00.358062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Role: member,reader Jun 22 09:30:00.358062 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Roles: member,reader Jun 22 09:30:00.359755 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b172c496b3304444bd6169a09cff85d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b172c496b3304444bd6169a09cff85d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b172c496b3304444bd6169a09cff85d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b172c496b3304444bd6169a09cff85d2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:30:00.359755 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2111643669 Jun 22 09:30:00.359755 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Id: b172c496b3304444bd6169a09cff85d2 Jun 22 09:30:00.359755 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2111643669 Jun 22 09:30:00.359755 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User: tempest-AttachVolumeShelveTestJSON-2111643669-project Jun 22 09:30:00.359755 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Id: default Jun 22 09:30:00.359755 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Name: Default Jun 22 09:30:00.359755 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Id: dc534f42584b4e57a4706c81729cacd5 Jun 22 09:30:00.359755 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2111643669-project Jun 22 09:30:00.359755 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: method: > Jun 22 09:30:00.359755 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: exception: Instance dce83571-cd21-48a3-b54d-b6218f563363 could not be found. Jun 22 09:30:00.359755 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: action_args: {'id': 'dce83571-cd21-48a3-b54d-b6218f563363'} Jun 22 09:30:00.361063 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:30:00.361063 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:30:00.361063 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:30:00.361063 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:30:00.361063 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:30:00.361063 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:30:00.361063 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:30:00.361063 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:30:00.361063 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:30:00.361063 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:30:00.361063 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dce83571-cd21-48a3-b54d-b6218f563363 could not be found. Jun 22 09:30:00.361063 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:30:00.361063 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:30:00.361063 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:30:00.361063 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:30:00.361063 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:30:00.361063 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:30:00.361063 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:30:00.361063 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:30:00.361063 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:30:00.362265 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:30:00.362265 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 09:30:00.362265 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 09:30:00.362265 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 09:30:00.362265 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 09:30:00.362265 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:30:00.362265 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:30:00.362265 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:30:00.362265 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:30:00.362265 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dce83571-cd21-48a3-b54d-b6218f563363 could not be found. Jun 22 09:30:00.362265 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:30:00.362265 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:30:00.362265 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:30:00.362265 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:30:00.362265 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:30:00.362265 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:30:00.362265 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:30:00.362265 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:30:00.362265 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dce83571-cd21-48a3-b54d-b6218f563363 could not be found. Jun 22 09:30:00.362265 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:30:00.364427 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-bf869eff-a6c5-4bb8-99f5-8a646ca25272 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Returning 404 to user: Instance dce83571-cd21-48a3-b54d-b6218f563363 could not be found. {{(pid=118025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:30:00.364901 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.network.neutron [None req-91142eeb-e91f-4470-86f3-83241a101006 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] validate_networks() for [('a75772f1-9e0a-482d-85cb-39939e4ffc1e', None, None, None, None, None)] {{(pid=118024) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:30:00.365318 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-bf869eff-a6c5-4bb8-99f5-8a646ca25272 tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 404 len: 111 microversion: 2.20 time: 0.067864 Jun 22 09:30:00.365867 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 909/1771] 10.222.0.16 () {60 vars in 1279 bytes} [Wed Jun 22 09:30:00 2022] DELETE /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 22 09:30:00.373746 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2058da45-9469-4ab2-a178-b8c957e0883b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:30:00.374349 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2058da45-9469-4ab2-a178-b8c957e0883b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] [instance: dce83571-cd21-48a3-b54d-b6218f563363] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:30:00.381239 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2058da45-9469-4ab2-a178-b8c957e0883b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:00.381685 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2058da45-9469-4ab2-a178-b8c957e0883b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:00.382446 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2058da45-9469-4ab2-a178-b8c957e0883b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:00.382876 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2058da45-9469-4ab2-a178-b8c957e0883b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:00.396416 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.wsgi [None req-2058da45-9469-4ab2-a178-b8c957e0883b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] HTTP exception thrown: Instance dce83571-cd21-48a3-b54d-b6218f563363 could not be found. Jun 22 09:30:00.397987 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2058da45-9469-4ab2-a178-b8c957e0883b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Request method failure captured: Jun 22 09:30:00.397987 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: request: GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 HTTP/1.1 Jun 22 09:30:00.397987 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept: application/json Jun 22 09:30:00.397987 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept-Encoding: identity Jun 22 09:30:00.397987 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Connection: close Jun 22 09:30:00.397987 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Length: 0 Jun 22 09:30:00.397987 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Type: application/json Jun 22 09:30:00.397987 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Host: 10.222.0.16 Jun 22 09:30:00.397987 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Openstack-System-Scope: None Jun 22 09:30:00.397987 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: User-Agent: python-urllib3/1.26.9 Jun 22 09:30:00.397987 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Auth-Token: gAAAAABistmshaECFGAHnRmYa6rYBXSOVD0Qua4uTG5avt1MhcK74DWY3z7j33DyNyPUEHkNAlpnveIdxiQXR4PVctEysp2-oZYhmBZfOkICvSxCioSV-tQOnSDfZ3AGE3xsfOtBMU0bgwdFz6BzWaVEfy2YGlGG8lqZlzBcaQ5nCEgZDL5ggws Jun 22 09:30:00.397987 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Id: None Jun 22 09:30:00.397987 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Name: None Jun 22 09:30:00.397987 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Identity-Status: Confirmed Jun 22 09:30:00.397987 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Is-Admin-Project: True Jun 22 09:30:00.397987 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 09:30:00.397987 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Id: default Jun 22 09:30:00.397987 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Name: Default Jun 22 09:30:00.397987 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Id: b172c496b3304444bd6169a09cff85d2 Jun 22 09:30:00.397987 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2111643669 Jun 22 09:30:00.397987 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Role: member,reader Jun 22 09:30:00.397987 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Roles: member,reader Jun 22 09:30:00.399411 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b172c496b3304444bd6169a09cff85d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b172c496b3304444bd6169a09cff85d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b172c496b3304444bd6169a09cff85d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b172c496b3304444bd6169a09cff85d2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:30:00.399411 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2111643669 Jun 22 09:30:00.399411 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Id: b172c496b3304444bd6169a09cff85d2 Jun 22 09:30:00.399411 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2111643669 Jun 22 09:30:00.399411 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User: tempest-AttachVolumeShelveTestJSON-2111643669-project Jun 22 09:30:00.399411 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Id: default Jun 22 09:30:00.399411 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Name: Default Jun 22 09:30:00.399411 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Id: dc534f42584b4e57a4706c81729cacd5 Jun 22 09:30:00.399411 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2111643669-project Jun 22 09:30:00.399411 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: method: > Jun 22 09:30:00.399411 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: exception: Instance dce83571-cd21-48a3-b54d-b6218f563363 could not be found. Jun 22 09:30:00.399411 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: action_args: {'id': 'dce83571-cd21-48a3-b54d-b6218f563363'} Jun 22 09:30:00.400144 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:30:00.400144 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:30:00.400144 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:30:00.400144 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:30:00.400144 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:30:00.400144 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:30:00.400144 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:30:00.400144 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:30:00.400144 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:30:00.400144 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:30:00.400144 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dce83571-cd21-48a3-b54d-b6218f563363 could not be found. Jun 22 09:30:00.400144 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:30:00.400144 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:30:00.400144 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:30:00.400144 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:30:00.400144 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:30:00.400144 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:30:00.400144 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:30:00.400144 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:30:00.400144 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:30:00.408834 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:30:00.408834 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:30:00.408834 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:30:00.408834 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:30:00.408834 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:30:00.408834 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:30:00.408834 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:30:00.408834 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dce83571-cd21-48a3-b54d-b6218f563363 could not be found. Jun 22 09:30:00.408834 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:30:00.408834 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:30:00.408834 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:30:00.408834 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:30:00.408834 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:30:00.408834 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:30:00.408834 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:30:00.408834 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:30:00.408834 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dce83571-cd21-48a3-b54d-b6218f563363 could not be found. Jun 22 09:30:00.408834 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:30:00.410000 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2058da45-9469-4ab2-a178-b8c957e0883b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] Returning 404 to user: Instance dce83571-cd21-48a3-b54d-b6218f563363 could not be found. {{(pid=118025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:30:00.410000 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2058da45-9469-4ab2-a178-b8c957e0883b tempest-AttachVolumeShelveTestJSON-2111643669 tempest-AttachVolumeShelveTestJSON-2111643669-project] 10.222.0.16 "GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363" status: 404 len: 111 microversion: 2.20 time: 0.029430 Jun 22 09:30:00.410000 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 910/1772] 10.222.0.16 () {60 vars in 1276 bytes} [Wed Jun 22 09:30:00 2022] GET /compute/v2.1/servers/dce83571-cd21-48a3-b54d-b6218f563363 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 22 09:30:00.799660 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-91142eeb-e91f-4470-86f3-83241a101006 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Flavor limits 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:30:00.800122 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-91142eeb-e91f-4470-86f3-83241a101006 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Image limits 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:30:00.800594 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-91142eeb-e91f-4470-86f3-83241a101006 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Flavor pref 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:30:00.801043 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-91142eeb-e91f-4470-86f3-83241a101006 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Image pref 0:0:0 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:30:00.801482 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.virt.hardware [None req-91142eeb-e91f-4470-86f3-83241a101006 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118024) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:30:00.810443 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-91142eeb-e91f-4470-86f3-83241a101006 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:00.810891 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-91142eeb-e91f-4470-86f3-83241a101006 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:00.811692 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-91142eeb-e91f-4470-86f3-83241a101006 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:00.812131 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-91142eeb-e91f-4470-86f3-83241a101006 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:00.830056 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.quota [None req-91142eeb-e91f-4470-86f3-83241a101006 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Getting quotas for project 175a336dc3fd44c2ae20e51b46d423e4. Resources: {'cores', 'instances', 'ram'} {{(pid=118024) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:30:00.834266 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.quota [None req-91142eeb-e91f-4470-86f3-83241a101006 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Getting quotas for user 566b001b7a504fadb85ad04ea1be22f2 and project 175a336dc3fd44c2ae20e51b46d423e4. Resources: {'cores', 'instances', 'ram'} {{(pid=118024) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:30:00.845419 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-91142eeb-e91f-4470-86f3-83241a101006 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Going to run 1 instances... {{(pid=118024) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:30:00.847733 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-91142eeb-e91f-4470-86f3-83241a101006 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c24d36a8-7909-4174-9b12-42c8d76647ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118024) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:30:01.015145 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-91142eeb-e91f-4470-86f3-83241a101006 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.769010 Jun 22 09:30:01.016010 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 863/1773] 10.222.0.16 () {60 vars in 1146 bytes} [Wed Jun 22 09:30:00 2022] POST /compute/v2.1/servers => generated 400 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:30:01.025930 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-b6faf8ee-d607-44a3-ae1a-300c3f3ff5de tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:30:01.026542 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-b6faf8ee-d607-44a3-ae1a-300c3f3ff5de tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:30:01.087827 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-b6faf8ee-d607-44a3-ae1a-300c3f3ff5de tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:30:01.094885 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-b6faf8ee-d607-44a3-ae1a-300c3f3ff5de tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836" status: 200 len: 1236 microversion: 2.1 time: 0.072905 Jun 22 09:30:01.096128 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 911/1774] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:30:01 2022] GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836 => generated 1236 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:30:02.111779 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-eb7ecdd3-9669-406b-a146-9f395512873c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:30:02.113124 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-eb7ecdd3-9669-406b-a146-9f395512873c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:30:02.120264 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-eb7ecdd3-9669-406b-a146-9f395512873c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:02.120978 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-eb7ecdd3-9669-406b-a146-9f395512873c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:02.122013 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-eb7ecdd3-9669-406b-a146-9f395512873c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:02.122684 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-eb7ecdd3-9669-406b-a146-9f395512873c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:02.194777 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-eb7ecdd3-9669-406b-a146-9f395512873c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:30:02.200660 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-eb7ecdd3-9669-406b-a146-9f395512873c tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836" status: 200 len: 1240 microversion: 2.1 time: 0.092952 Jun 22 09:30:02.201460 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 864/1775] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:30:02 2022] GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836 => generated 1240 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:30:03.218634 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-4b8986f2-2b51-4c5e-b744-35d04edab355 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:30:03.219255 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-4b8986f2-2b51-4c5e-b744-35d04edab355 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:30:03.241167 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4b8986f2-2b51-4c5e-b744-35d04edab355 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:03.242871 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4b8986f2-2b51-4c5e-b744-35d04edab355 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:03.243850 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4b8986f2-2b51-4c5e-b744-35d04edab355 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:03.245169 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4b8986f2-2b51-4c5e-b744-35d04edab355 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:03.339279 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-4b8986f2-2b51-4c5e-b744-35d04edab355 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:30:03.356141 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-4b8986f2-2b51-4c5e-b744-35d04edab355 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836" status: 200 len: 1296 microversion: 2.1 time: 0.141385 Jun 22 09:30:03.356732 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 912/1776] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:30:03 2022] GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836 => generated 1296 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:30:04.376573 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b62a8243-3c12-4741-b9a5-5df4fa02521a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:30:04.376573 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-b62a8243-3c12-4741-b9a5-5df4fa02521a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:30:04.383122 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b62a8243-3c12-4741-b9a5-5df4fa02521a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:04.383632 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b62a8243-3c12-4741-b9a5-5df4fa02521a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:04.384398 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b62a8243-3c12-4741-b9a5-5df4fa02521a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:04.384859 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b62a8243-3c12-4741-b9a5-5df4fa02521a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:04.538736 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-b62a8243-3c12-4741-b9a5-5df4fa02521a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:30:04.546492 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-b62a8243-3c12-4741-b9a5-5df4fa02521a tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836" status: 200 len: 1360 microversion: 2.1 time: 0.175304 Jun 22 09:30:04.546996 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 865/1777] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:30:04 2022] GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836 => generated 1360 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:30:05.563819 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-7cd31233-4411-4697-8d65-5243bec6ceb8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:30:05.564448 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-7cd31233-4411-4697-8d65-5243bec6ceb8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:30:05.577726 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7cd31233-4411-4697-8d65-5243bec6ceb8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:05.583304 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7cd31233-4411-4697-8d65-5243bec6ceb8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:05.583304 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7cd31233-4411-4697-8d65-5243bec6ceb8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:05.583304 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7cd31233-4411-4697-8d65-5243bec6ceb8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:05.746833 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-af9836c6-1e4a-4a08-ac12-016a74478d40 req-5390f4c9-d278-454d-85c6-1fd8fa436a38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5963af0a-3ebd-4734-9c3e-d656a5ba9836", "tag": "4a5add3d-5c67-4fe6-879f-fbd8949f599a"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:30:05.758619 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-af9836c6-1e4a-4a08-ac12-016a74478d40 req-5390f4c9-d278-454d-85c6-1fd8fa436a38 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:05.758619 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-af9836c6-1e4a-4a08-ac12-016a74478d40 req-5390f4c9-d278-454d-85c6-1fd8fa436a38 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:05.776882 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-af9836c6-1e4a-4a08-ac12-016a74478d40 req-5390f4c9-d278-454d-85c6-1fd8fa436a38 service nova] Creating event network-changed:4a5add3d-5c67-4fe6-879f-fbd8949f599a for instance 5963af0a-3ebd-4734-9c3e-d656a5ba9836 on hv-cinder-84599 Jun 22 09:30:05.784823 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-af9836c6-1e4a-4a08-ac12-016a74478d40 req-5390f4c9-d278-454d-85c6-1fd8fa436a38 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.258956 Jun 22 09:30:05.785775 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 913/1778] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:30:05.805940 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-7cd31233-4411-4697-8d65-5243bec6ceb8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:30:05.808235 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=78 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:30:05.815043 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-7cd31233-4411-4697-8d65-5243bec6ceb8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836" status: 200 len: 1360 microversion: 2.1 time: 0.255355 Jun 22 09:30:05.815862 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 866/1779] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:30:05 2022] GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836 => generated 1360 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:30:06.832868 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9a908be4-2667-49c0-ab7b-f4021006b8b3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:30:06.833588 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9a908be4-2667-49c0-ab7b-f4021006b8b3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:30:06.839847 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9a908be4-2667-49c0-ab7b-f4021006b8b3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:06.840297 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9a908be4-2667-49c0-ab7b-f4021006b8b3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:06.841094 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9a908be4-2667-49c0-ab7b-f4021006b8b3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:06.841527 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9a908be4-2667-49c0-ab7b-f4021006b8b3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:07.141689 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9a908be4-2667-49c0-ab7b-f4021006b8b3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:30:07.150493 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9a908be4-2667-49c0-ab7b-f4021006b8b3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836" status: 200 len: 1360 microversion: 2.1 time: 0.322972 Jun 22 09:30:07.151056 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 914/1780] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:30:06 2022] GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836 => generated 1360 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:30:08.167889 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-5b2e1a1f-8f2f-45a9-a450-44b8d10fa6e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:30:08.168497 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-5b2e1a1f-8f2f-45a9-a450-44b8d10fa6e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:30:08.176385 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5b2e1a1f-8f2f-45a9-a450-44b8d10fa6e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:08.176923 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5b2e1a1f-8f2f-45a9-a450-44b8d10fa6e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:08.177741 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5b2e1a1f-8f2f-45a9-a450-44b8d10fa6e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:08.178232 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5b2e1a1f-8f2f-45a9-a450-44b8d10fa6e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:08.309836 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-5b2e1a1f-8f2f-45a9-a450-44b8d10fa6e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:30:08.317543 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-5b2e1a1f-8f2f-45a9-a450-44b8d10fa6e1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836" status: 200 len: 1360 microversion: 2.1 time: 0.153546 Jun 22 09:30:08.318114 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 867/1781] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:30:08 2022] GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836 => generated 1360 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:30:09.335684 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-623d1bca-3758-4f5f-8471-bb49ef1c5d36 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:30:09.336330 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-623d1bca-3758-4f5f-8471-bb49ef1c5d36 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:30:09.338421 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:30:09.343291 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-623d1bca-3758-4f5f-8471-bb49ef1c5d36 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:09.343738 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-623d1bca-3758-4f5f-8471-bb49ef1c5d36 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:09.344500 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-623d1bca-3758-4f5f-8471-bb49ef1c5d36 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:09.344960 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-623d1bca-3758-4f5f-8471-bb49ef1c5d36 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:09.473745 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-623d1bca-3758-4f5f-8471-bb49ef1c5d36 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:30:09.481178 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-623d1bca-3758-4f5f-8471-bb49ef1c5d36 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836" status: 200 len: 1360 microversion: 2.1 time: 0.150707 Jun 22 09:30:09.481989 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 915/1782] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:30:09 2022] GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836 => generated 1360 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:30:10.500815 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-8520e16d-2d54-4870-a24d-683d8c623774 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:30:10.501363 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-8520e16d-2d54-4870-a24d-683d8c623774 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:30:10.507822 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8520e16d-2d54-4870-a24d-683d8c623774 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:10.508274 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8520e16d-2d54-4870-a24d-683d8c623774 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:10.509069 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8520e16d-2d54-4870-a24d-683d8c623774 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:10.509513 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8520e16d-2d54-4870-a24d-683d8c623774 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:10.641245 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-8520e16d-2d54-4870-a24d-683d8c623774 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:30:10.649407 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-8520e16d-2d54-4870-a24d-683d8c623774 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836" status: 200 len: 1360 microversion: 2.1 time: 0.152658 Jun 22 09:30:10.649966 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 868/1783] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:30:10 2022] GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836 => generated 1360 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:30:11.666315 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9ccd5925-b431-486e-876e-a8e7ae81db00 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:30:11.666934 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9ccd5925-b431-486e-876e-a8e7ae81db00 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:30:11.669175 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell0:SELECT=6 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:30:11.674038 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9ccd5925-b431-486e-876e-a8e7ae81db00 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:11.675047 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9ccd5925-b431-486e-876e-a8e7ae81db00 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:11.675825 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9ccd5925-b431-486e-876e-a8e7ae81db00 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:11.676262 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9ccd5925-b431-486e-876e-a8e7ae81db00 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:11.678533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell0:SELECT=2 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:30:11.679406 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell0:SELECT=6 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:30:11.680561 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=72 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:30:11.807866 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [req-d49fb7ff-ab64-44ad-b8b9-585964c4dd83 req-c51c0c58-3593-4362-a871-dc804d2a03e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5963af0a-3ebd-4734-9c3e-d656a5ba9836", "name": "network-vif-plugged", "status": "completed", "tag": "4a5add3d-5c67-4fe6-879f-fbd8949f599a"}]} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:30:11.819696 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9ccd5925-b431-486e-876e-a8e7ae81db00 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:30:11.823006 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-d49fb7ff-ab64-44ad-b8b9-585964c4dd83 req-c51c0c58-3593-4362-a871-dc804d2a03e8 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:11.823472 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-d49fb7ff-ab64-44ad-b8b9-585964c4dd83 req-c51c0c58-3593-4362-a871-dc804d2a03e8 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:11.827997 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9ccd5925-b431-486e-876e-a8e7ae81db00 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836" status: 200 len: 1360 microversion: 2.1 time: 0.165584 Jun 22 09:30:11.828650 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 916/1784] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:30:11 2022] GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836 => generated 1360 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:30:11.835762 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.compute.server_external_events [req-d49fb7ff-ab64-44ad-b8b9-585964c4dd83 req-c51c0c58-3593-4362-a871-dc804d2a03e8 service nova] Creating event network-vif-plugged:4a5add3d-5c67-4fe6-879f-fbd8949f599a for instance 5963af0a-3ebd-4734-9c3e-d656a5ba9836 on hv-cinder-84599 Jun 22 09:30:11.840954 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [req-d49fb7ff-ab64-44ad-b8b9-585964c4dd83 req-c51c0c58-3593-4362-a871-dc804d2a03e8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167842 Jun 22 09:30:11.841541 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 869/1785] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:30:12.846329 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-54b1373b-3c4f-45cd-9de5-6bbad796ac5d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:30:12.846889 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-54b1373b-3c4f-45cd-9de5-6bbad796ac5d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:30:12.853869 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-54b1373b-3c4f-45cd-9de5-6bbad796ac5d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:12.854320 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-54b1373b-3c4f-45cd-9de5-6bbad796ac5d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:12.855082 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-54b1373b-3c4f-45cd-9de5-6bbad796ac5d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:12.855520 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-54b1373b-3c4f-45cd-9de5-6bbad796ac5d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:12.986094 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-54b1373b-3c4f-45cd-9de5-6bbad796ac5d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:30:12.993562 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-54b1373b-3c4f-45cd-9de5-6bbad796ac5d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836" status: 200 len: 1360 microversion: 2.1 time: 0.151295 Jun 22 09:30:12.994115 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 917/1786] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:30:12 2022] GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836 => generated 1360 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:30:14.012426 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ccaf764b-0289-410e-8534-099e4cad615d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:30:14.013148 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ccaf764b-0289-410e-8534-099e4cad615d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:30:14.015045 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:30:14.021006 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ccaf764b-0289-410e-8534-099e4cad615d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:14.021463 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ccaf764b-0289-410e-8534-099e4cad615d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:14.022220 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ccaf764b-0289-410e-8534-099e4cad615d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:14.022812 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ccaf764b-0289-410e-8534-099e4cad615d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:14.159652 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ccaf764b-0289-410e-8534-099e4cad615d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:30:14.168215 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ccaf764b-0289-410e-8534-099e4cad615d tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836" status: 200 len: 1360 microversion: 2.1 time: 0.161026 Jun 22 09:30:14.168811 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 870/1787] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:30:14 2022] GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836 => generated 1360 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:30:15.184946 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-841a3dc4-2cd0-4b30-bef2-bdacd15037b1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:30:15.185593 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-841a3dc4-2cd0-4b30-bef2-bdacd15037b1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:30:15.192183 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-841a3dc4-2cd0-4b30-bef2-bdacd15037b1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:15.192629 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-841a3dc4-2cd0-4b30-bef2-bdacd15037b1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:15.193422 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-841a3dc4-2cd0-4b30-bef2-bdacd15037b1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:15.193859 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-841a3dc4-2cd0-4b30-bef2-bdacd15037b1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:15.324924 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-841a3dc4-2cd0-4b30-bef2-bdacd15037b1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:30:15.332405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-841a3dc4-2cd0-4b30-bef2-bdacd15037b1 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836" status: 200 len: 1546 microversion: 2.1 time: 0.151368 Jun 22 09:30:15.332983 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 918/1788] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:30:15 2022] GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836 => generated 1546 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:30:15.349491 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-6525b4e0-08e2-408f-a40c-3b5828d5d4d3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:30:15.350093 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-6525b4e0-08e2-408f-a40c-3b5828d5d4d3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:30:15.357053 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6525b4e0-08e2-408f-a40c-3b5828d5d4d3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:15.357752 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6525b4e0-08e2-408f-a40c-3b5828d5d4d3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:15.358504 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6525b4e0-08e2-408f-a40c-3b5828d5d4d3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:15.358941 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-6525b4e0-08e2-408f-a40c-3b5828d5d4d3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:15.439716 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-6525b4e0-08e2-408f-a40c-3b5828d5d4d3 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094970 Jun 22 09:30:15.440306 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 871/1789] 10.222.0.16 () {58 vars in 1274 bytes} [Wed Jun 22 09:30:15 2022] GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:30:16.832226 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-63e9cfdc-5fe4-4ff9-be30-de22b4d76e3f req-96895d8c-67ac-42dc-be28-5404842fe1b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5963af0a-3ebd-4734-9c3e-d656a5ba9836", "tag": "4a5add3d-5c67-4fe6-879f-fbd8949f599a"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:30:16.840422 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-63e9cfdc-5fe4-4ff9-be30-de22b4d76e3f req-96895d8c-67ac-42dc-be28-5404842fe1b4 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:30:16.840886 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-63e9cfdc-5fe4-4ff9-be30-de22b4d76e3f req-96895d8c-67ac-42dc-be28-5404842fe1b4 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:30:16.852377 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-63e9cfdc-5fe4-4ff9-be30-de22b4d76e3f req-96895d8c-67ac-42dc-be28-5404842fe1b4 service nova] Creating event network-changed:4a5add3d-5c67-4fe6-879f-fbd8949f599a for instance 5963af0a-3ebd-4734-9c3e-d656a5ba9836 on hv-cinder-84599 Jun 22 09:30:16.857908 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-63e9cfdc-5fe4-4ff9-be30-de22b4d76e3f req-96895d8c-67ac-42dc-be28-5404842fe1b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082935 Jun 22 09:30:16.858487 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 919/1790] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:31:31.885434 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=3 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:31:31.886188 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=25 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:31:31.891070 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-9ec280df-e902-4e12-a85d-e2ccd98cd97b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:31:31.891555 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-9ec280df-e902-4e12-a85d-e2ccd98cd97b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:31:31.897421 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9ec280df-e902-4e12-a85d-e2ccd98cd97b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:31:31.903203 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9ec280df-e902-4e12-a85d-e2ccd98cd97b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:31:31.903203 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9ec280df-e902-4e12-a85d-e2ccd98cd97b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:31:31.903203 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9ec280df-e902-4e12-a85d-e2ccd98cd97b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:31:31.925365 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-9ec280df-e902-4e12-a85d-e2ccd98cd97b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836/ips" status: 200 len: 145 microversion: 2.1 time: 0.041758 Jun 22 09:31:31.925851 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 872/1791] 10.222.0.16 () {58 vars in 1247 bytes} [Wed Jun 22 09:31:31 2022] GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:31:39.218703 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:31:39.219176 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Wed Jun 22 09:31:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:32:39.679241 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR oslo.messaging._drivers.impl_rabbit [-] [464973eb-4c05-4793-ab21-ab2184288628] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 22 09:32:39.687363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=9 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:32:39.687363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=19 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:32:39.687363 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7d1306da-5715-490b-88ed-6147c0d51bf9 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:32:39.688010 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7d1306da-5715-490b-88ed-6147c0d51bf9 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: 46fa6d8c-afd7-4385-a727-ee8d14223669] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:32:39.696351 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7d1306da-5715-490b-88ed-6147c0d51bf9 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:32:39.696902 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7d1306da-5715-490b-88ed-6147c0d51bf9 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:32:39.698669 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7d1306da-5715-490b-88ed-6147c0d51bf9 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:32:39.699104 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7d1306da-5715-490b-88ed-6147c0d51bf9 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:32:39.715716 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.wsgi [None req-7d1306da-5715-490b-88ed-6147c0d51bf9 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] HTTP exception thrown: Instance 46fa6d8c-afd7-4385-a727-ee8d14223669 could not be found. Jun 22 09:32:39.715716 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7d1306da-5715-490b-88ed-6147c0d51bf9 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Request method failure captured: Jun 22 09:32:39.715716 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: request: DELETE /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669 HTTP/1.1 Jun 22 09:32:39.715716 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept: application/json Jun 22 09:32:39.715716 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept-Encoding: identity Jun 22 09:32:39.715716 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Connection: close Jun 22 09:32:39.715716 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Length: 0 Jun 22 09:32:39.715716 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Type: application/json Jun 22 09:32:39.715716 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Host: 10.222.0.16 Jun 22 09:32:39.715716 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Openstack-System-Scope: None Jun 22 09:32:39.715716 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: User-Agent: python-urllib3/1.26.9 Jun 22 09:32:39.715716 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Auth-Token: gAAAAABistmqD47tOpCEfZxXQ7v8d4kDBzbZcFIWDuyhnuGnU13mxMlhbgt18xo2M0HJq-gXeYBWo0pfkDLuGB3yaG8TUwjVHhSVzhHn4vsUiwL4uQjCeCtk_V7_A6rYsksudlP-79icDu6EqbcTRNIwpnAGEp7HhBlOtNGTaFEH_UUlynGlRmI Jun 22 09:32:39.715716 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Id: None Jun 22 09:32:39.715716 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Name: None Jun 22 09:32:39.715716 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Identity-Status: Confirmed Jun 22 09:32:39.715716 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Is-Admin-Project: True Jun 22 09:32:39.715716 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Id: default Jun 22 09:32:39.715716 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Name: Default Jun 22 09:32:39.715716 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Id: 9ebdcb9809a84f25bd578f8aca09802c Jun 22 09:32:39.715716 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Name: tempest-AttachVolumeNegativeTest-914919780 Jun 22 09:32:39.715716 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Role: member,reader Jun 22 09:32:39.715716 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Roles: member,reader Jun 22 09:32:39.717190 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebdcb9809a84f25bd578f8aca09802c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebdcb9809a84f25bd578f8aca09802c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ebdcb9809a84f25bd578f8aca09802c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ebdcb9809a84f25bd578f8aca09802c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:32:39.717190 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant: tempest-AttachVolumeNegativeTest-914919780 Jun 22 09:32:39.717190 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Id: 9ebdcb9809a84f25bd578f8aca09802c Jun 22 09:32:39.717190 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-914919780 Jun 22 09:32:39.717190 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User: tempest-AttachVolumeNegativeTest-914919780-project Jun 22 09:32:39.717190 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Id: default Jun 22 09:32:39.717190 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Name: Default Jun 22 09:32:39.717190 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Id: 71ea2610ccc044de9d66444b4038fe9e Jun 22 09:32:39.717190 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Name: tempest-AttachVolumeNegativeTest-914919780-project Jun 22 09:32:39.717190 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: method: > Jun 22 09:32:39.717190 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: exception: Instance 46fa6d8c-afd7-4385-a727-ee8d14223669 could not be found. Jun 22 09:32:39.717190 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: action_args: {'id': '46fa6d8c-afd7-4385-a727-ee8d14223669'} Jun 22 09:32:39.717884 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:32:39.717884 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:32:39.717884 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:32:39.717884 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:32:39.717884 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:32:39.717884 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:32:39.717884 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:32:39.717884 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:32:39.717884 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:32:39.717884 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:32:39.717884 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46fa6d8c-afd7-4385-a727-ee8d14223669 could not be found. Jun 22 09:32:39.717884 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:32:39.717884 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:32:39.717884 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:32:39.717884 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:32:39.717884 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:32:39.717884 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:32:39.717884 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:32:39.717884 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:32:39.717884 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:32:39.718947 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:32:39.718947 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 09:32:39.718947 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 09:32:39.718947 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 09:32:39.718947 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 09:32:39.718947 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:32:39.718947 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:32:39.718947 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:32:39.718947 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:32:39.718947 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46fa6d8c-afd7-4385-a727-ee8d14223669 could not be found. Jun 22 09:32:39.718947 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:32:39.718947 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:32:39.718947 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:32:39.718947 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:32:39.718947 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:32:39.718947 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:32:39.718947 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:32:39.718947 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:32:39.718947 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46fa6d8c-afd7-4385-a727-ee8d14223669 could not be found. Jun 22 09:32:39.718947 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:32:39.721449 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7d1306da-5715-490b-88ed-6147c0d51bf9 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Returning 404 to user: Instance 46fa6d8c-afd7-4385-a727-ee8d14223669 could not be found. {{(pid=118025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:32:39.721449 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7d1306da-5715-490b-88ed-6147c0d51bf9 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "DELETE /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669" status: 404 len: 111 microversion: 2.1 time: 0.039150 Jun 22 09:32:39.721449 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 920/1792] 10.222.0.16 () {58 vars in 1238 bytes} [Wed Jun 22 09:32:39 2022] DELETE /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:32:39.727092 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b82762c1-36ee-4632-908a-75a182d52da1 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:32:39.727704 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-b82762c1-36ee-4632-908a-75a182d52da1 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: 46fa6d8c-afd7-4385-a727-ee8d14223669] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:32:39.734208 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b82762c1-36ee-4632-908a-75a182d52da1 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:32:39.734657 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b82762c1-36ee-4632-908a-75a182d52da1 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:32:39.735476 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b82762c1-36ee-4632-908a-75a182d52da1 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:32:39.735914 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b82762c1-36ee-4632-908a-75a182d52da1 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:32:39.749981 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.wsgi [None req-b82762c1-36ee-4632-908a-75a182d52da1 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] HTTP exception thrown: Instance 46fa6d8c-afd7-4385-a727-ee8d14223669 could not be found. Jun 22 09:32:39.751682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b82762c1-36ee-4632-908a-75a182d52da1 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Request method failure captured: Jun 22 09:32:39.751682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: request: GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669 HTTP/1.1 Jun 22 09:32:39.751682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept: application/json Jun 22 09:32:39.751682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept-Encoding: identity Jun 22 09:32:39.751682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Connection: close Jun 22 09:32:39.751682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Length: 0 Jun 22 09:32:39.751682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Type: application/json Jun 22 09:32:39.751682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Host: 10.222.0.16 Jun 22 09:32:39.751682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Openstack-System-Scope: None Jun 22 09:32:39.751682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: User-Agent: python-urllib3/1.26.9 Jun 22 09:32:39.751682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Auth-Token: gAAAAABistmqD47tOpCEfZxXQ7v8d4kDBzbZcFIWDuyhnuGnU13mxMlhbgt18xo2M0HJq-gXeYBWo0pfkDLuGB3yaG8TUwjVHhSVzhHn4vsUiwL4uQjCeCtk_V7_A6rYsksudlP-79icDu6EqbcTRNIwpnAGEp7HhBlOtNGTaFEH_UUlynGlRmI Jun 22 09:32:39.751682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Id: None Jun 22 09:32:39.751682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Name: None Jun 22 09:32:39.751682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Identity-Status: Confirmed Jun 22 09:32:39.751682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Is-Admin-Project: True Jun 22 09:32:39.751682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Id: default Jun 22 09:32:39.751682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Name: Default Jun 22 09:32:39.751682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Id: 9ebdcb9809a84f25bd578f8aca09802c Jun 22 09:32:39.751682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Name: tempest-AttachVolumeNegativeTest-914919780 Jun 22 09:32:39.751682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Role: member,reader Jun 22 09:32:39.751682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Roles: member,reader Jun 22 09:32:39.752966 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebdcb9809a84f25bd578f8aca09802c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebdcb9809a84f25bd578f8aca09802c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ebdcb9809a84f25bd578f8aca09802c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ebdcb9809a84f25bd578f8aca09802c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:32:39.752966 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant: tempest-AttachVolumeNegativeTest-914919780 Jun 22 09:32:39.752966 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Id: 9ebdcb9809a84f25bd578f8aca09802c Jun 22 09:32:39.752966 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-914919780 Jun 22 09:32:39.752966 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User: tempest-AttachVolumeNegativeTest-914919780-project Jun 22 09:32:39.752966 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Id: default Jun 22 09:32:39.752966 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Name: Default Jun 22 09:32:39.752966 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Id: 71ea2610ccc044de9d66444b4038fe9e Jun 22 09:32:39.752966 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Name: tempest-AttachVolumeNegativeTest-914919780-project Jun 22 09:32:39.752966 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: method: > Jun 22 09:32:39.752966 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: exception: Instance 46fa6d8c-afd7-4385-a727-ee8d14223669 could not be found. Jun 22 09:32:39.752966 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: action_args: {'id': '46fa6d8c-afd7-4385-a727-ee8d14223669'} Jun 22 09:32:39.753694 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:32:39.753694 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:32:39.753694 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:32:39.753694 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:32:39.753694 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:32:39.753694 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:32:39.753694 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:32:39.753694 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:32:39.753694 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:32:39.753694 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:32:39.753694 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46fa6d8c-afd7-4385-a727-ee8d14223669 could not be found. Jun 22 09:32:39.753694 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:32:39.753694 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:32:39.753694 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:32:39.753694 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:32:39.753694 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:32:39.753694 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:32:39.753694 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:32:39.753694 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:32:39.753694 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:32:39.757795 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:32:39.757795 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:32:39.757795 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:32:39.757795 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:32:39.757795 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:32:39.757795 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:32:39.757795 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:32:39.757795 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46fa6d8c-afd7-4385-a727-ee8d14223669 could not be found. Jun 22 09:32:39.757795 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:32:39.757795 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:32:39.757795 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:32:39.757795 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:32:39.757795 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:32:39.757795 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:32:39.757795 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:32:39.757795 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:32:39.757795 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46fa6d8c-afd7-4385-a727-ee8d14223669 could not be found. Jun 22 09:32:39.757795 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:32:39.758868 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b82762c1-36ee-4632-908a-75a182d52da1 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Returning 404 to user: Instance 46fa6d8c-afd7-4385-a727-ee8d14223669 could not be found. {{(pid=118024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:32:39.758868 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-b82762c1-36ee-4632-908a-75a182d52da1 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669" status: 404 len: 111 microversion: 2.1 time: 0.032425 Jun 22 09:32:39.758868 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 873/1793] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:32:39 2022] GET /compute/v2.1/servers/46fa6d8c-afd7-4385-a727-ee8d14223669 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:32:54.402859 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:32:54.403491 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Wed Jun 22 09:32:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:33:13.324150 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:33:13.324641 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Wed Jun 22 09:33:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:33:17.141979 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:33:17.142572 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Wed Jun 22 09:33:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:34:06.830194 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-fe915b7c-4b9a-43ee-a922-43b9e2f13886 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b1293c5-b640-465c-a86a-cbe4d90fe6a1"}} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:34:06.831340 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-fe915b7c-4b9a-43ee-a922-43b9e2f13886 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:34:06.842883 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO oslo.messaging._drivers.impl_rabbit [-] [464973eb-4c05-4793-ab21-ab2184288628] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 44512. Jun 22 09:34:06.844940 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fe915b7c-4b9a-43ee-a922-43b9e2f13886 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:06.845647 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fe915b7c-4b9a-43ee-a922-43b9e2f13886 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:06.846458 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fe915b7c-4b9a-43ee-a922-43b9e2f13886 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:06.846908 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fe915b7c-4b9a-43ee-a922-43b9e2f13886 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:07.698389 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-fe915b7c-4b9a-43ee-a922-43b9e2f13886 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "POST /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.875788 Jun 22 09:34:07.699554 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 921/1794] 10.222.0.16 () {60 vars in 1322 bytes} [Wed Jun 22 09:34:06 2022] POST /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836/os-volume_attachments => generated 194 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:34:22.930196 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR oslo.messaging._drivers.impl_rabbit [-] [37c3933e-4411-44e7-89c0-9c9368201568] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 22 09:34:22.934752 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ef1695cc-a70c-4067-bb52-730d0b6f3e78 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:34:22.935982 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ef1695cc-a70c-4067-bb52-730d0b6f3e78 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:34:22.938284 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=4 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:34:22.938922 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=6 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:34:22.944929 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ef1695cc-a70c-4067-bb52-730d0b6f3e78 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:22.945592 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ef1695cc-a70c-4067-bb52-730d0b6f3e78 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:22.946398 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ef1695cc-a70c-4067-bb52-730d0b6f3e78 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:22.946816 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ef1695cc-a70c-4067-bb52-730d0b6f3e78 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:22.978118 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ef1695cc-a70c-4067-bb52-730d0b6f3e78 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050078 Jun 22 09:34:22.978686 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 874/1795] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:34:22 2022] GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:34:22.986770 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=4 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:34:22.987815 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:34:22.992626 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e24200c0-b5e9-4775-ac60-41c88e71a4f8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:34:22.993346 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e24200c0-b5e9-4775-ac60-41c88e71a4f8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:34:23.000446 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e24200c0-b5e9-4775-ac60-41c88e71a4f8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:23.000935 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e24200c0-b5e9-4775-ac60-41c88e71a4f8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:23.001705 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e24200c0-b5e9-4775-ac60-41c88e71a4f8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:23.002156 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e24200c0-b5e9-4775-ac60-41c88e71a4f8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:23.032689 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e24200c0-b5e9-4775-ac60-41c88e71a4f8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836/os-volume_attachments/3b1293c5-b640-465c-a86a-cbe4d90fe6a1" status: 200 len: 194 microversion: 2.1 time: 0.047449 Jun 22 09:34:23.033466 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 922/1796] 10.222.0.16 () {58 vars in 1412 bytes} [Wed Jun 22 09:34:22 2022] GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836/os-volume_attachments/3b1293c5-b640-465c-a86a-cbe4d90fe6a1 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:34:29.005885 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-4e6699a5-8d83-47b3-9df1-49c4165102ff tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f27f45e0-024d-4162-87c5-861b7a4be6c5"}} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:34:29.006951 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-4e6699a5-8d83-47b3-9df1-49c4165102ff tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:34:29.015906 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4e6699a5-8d83-47b3-9df1-49c4165102ff tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:29.016357 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4e6699a5-8d83-47b3-9df1-49c4165102ff tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:29.017156 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4e6699a5-8d83-47b3-9df1-49c4165102ff tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:29.017594 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4e6699a5-8d83-47b3-9df1-49c4165102ff tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:29.033378 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO oslo.messaging._drivers.impl_rabbit [-] [37c3933e-4411-44e7-89c0-9c9368201568] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 44894. Jun 22 09:34:29.968355 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-4e6699a5-8d83-47b3-9df1-49c4165102ff tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "POST /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.966343 Jun 22 09:34:29.971280 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 875/1797] 10.222.0.16 () {60 vars in 1322 bytes} [Wed Jun 22 09:34:29 2022] POST /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836/os-volume_attachments => generated 194 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:34:38.761635 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d9dd044a-a625-4c16-881a-6be3d55dcedd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:34:38.764117 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-d9dd044a-a625-4c16-881a-6be3d55dcedd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:34:38.772382 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d9dd044a-a625-4c16-881a-6be3d55dcedd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:38.772950 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d9dd044a-a625-4c16-881a-6be3d55dcedd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:38.773794 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d9dd044a-a625-4c16-881a-6be3d55dcedd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:38.774304 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d9dd044a-a625-4c16-881a-6be3d55dcedd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:38.806447 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d9dd044a-a625-4c16-881a-6be3d55dcedd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049736 Jun 22 09:34:38.809261 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 923/1798] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:34:38 2022] GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:34:38.958635 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-7ef32a9e-1681-414c-bc41-0947432629b8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:34:38.959189 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-7ef32a9e-1681-414c-bc41-0947432629b8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:34:38.966871 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7ef32a9e-1681-414c-bc41-0947432629b8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:38.967332 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7ef32a9e-1681-414c-bc41-0947432629b8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:38.968719 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7ef32a9e-1681-414c-bc41-0947432629b8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:38.969289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7ef32a9e-1681-414c-bc41-0947432629b8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:39.006114 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-7ef32a9e-1681-414c-bc41-0947432629b8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836/os-volume_attachments/3b1293c5-b640-465c-a86a-cbe4d90fe6a1" status: 200 len: 194 microversion: 2.1 time: 0.052878 Jun 22 09:34:39.006738 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 876/1799] 10.222.0.16 () {58 vars in 1412 bytes} [Wed Jun 22 09:34:38 2022] GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836/os-volume_attachments/3b1293c5-b640-465c-a86a-cbe4d90fe6a1 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:34:39.021291 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9d52d244-2095-4d76-bfc1-8e477de2cd3b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:34:39.021906 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9d52d244-2095-4d76-bfc1-8e477de2cd3b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:34:39.028151 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9d52d244-2095-4d76-bfc1-8e477de2cd3b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:39.028586 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9d52d244-2095-4d76-bfc1-8e477de2cd3b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:39.029461 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9d52d244-2095-4d76-bfc1-8e477de2cd3b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:39.029993 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9d52d244-2095-4d76-bfc1-8e477de2cd3b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:39.131517 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.objects.instance [None req-9d52d244-2095-4d76-bfc1-8e477de2cd3b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lazy-loading 'services' on Instance uuid 5963af0a-3ebd-4734-9c3e-d656a5ba9836 {{(pid=118025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:34:39.380436 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9d52d244-2095-4d76-bfc1-8e477de2cd3b tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836/os-volume_attachments/3b1293c5-b640-465c-a86a-cbe4d90fe6a1" status: 202 len: 0 microversion: 2.1 time: 0.357914 Jun 22 09:34:39.380436 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 924/1800] 10.222.0.16 () {58 vars in 1415 bytes} [Wed Jun 22 09:34:39 2022] DELETE /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836/os-volume_attachments/3b1293c5-b640-465c-a86a-cbe4d90fe6a1 => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:34:41.578938 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-dba6db2d-ac25-4b69-842c-3fcc29385b86 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:34:41.579847 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-dba6db2d-ac25-4b69-842c-3fcc29385b86 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:34:41.586359 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dba6db2d-ac25-4b69-842c-3fcc29385b86 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:41.586874 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dba6db2d-ac25-4b69-842c-3fcc29385b86 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:41.587567 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dba6db2d-ac25-4b69-842c-3fcc29385b86 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:41.588002 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dba6db2d-ac25-4b69-842c-3fcc29385b86 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:41.625292 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-dba6db2d-ac25-4b69-842c-3fcc29385b86 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836/os-volume_attachments/f27f45e0-024d-4162-87c5-861b7a4be6c5" status: 200 len: 194 microversion: 2.1 time: 0.051050 Jun 22 09:34:41.625948 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 877/1801] 10.222.0.16 () {58 vars in 1412 bytes} [Wed Jun 22 09:34:41 2022] GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836/os-volume_attachments/f27f45e0-024d-4162-87c5-861b7a4be6c5 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:34:41.641234 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-31d867b6-85ca-4e19-a141-b2c3d169c334 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:34:41.646957 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-31d867b6-85ca-4e19-a141-b2c3d169c334 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:34:41.650741 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-31d867b6-85ca-4e19-a141-b2c3d169c334 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:41.651385 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-31d867b6-85ca-4e19-a141-b2c3d169c334 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:41.653088 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-31d867b6-85ca-4e19-a141-b2c3d169c334 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:41.653801 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-31d867b6-85ca-4e19-a141-b2c3d169c334 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:41.762847 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.objects.instance [None req-31d867b6-85ca-4e19-a141-b2c3d169c334 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lazy-loading 'services' on Instance uuid 5963af0a-3ebd-4734-9c3e-d656a5ba9836 {{(pid=118025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:34:42.047849 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-31d867b6-85ca-4e19-a141-b2c3d169c334 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836/os-volume_attachments/f27f45e0-024d-4162-87c5-861b7a4be6c5" status: 202 len: 0 microversion: 2.1 time: 0.415576 Jun 22 09:34:42.048436 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 925/1802] 10.222.0.16 () {58 vars in 1415 bytes} [Wed Jun 22 09:34:41 2022] DELETE /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836/os-volume_attachments/f27f45e0-024d-4162-87c5-861b7a4be6c5 => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 09:34:44.376916 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-065ccb20-c389-40fa-a1ab-625dcb107afb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:34:44.378840 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-065ccb20-c389-40fa-a1ab-625dcb107afb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:34:44.386630 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-065ccb20-c389-40fa-a1ab-625dcb107afb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:44.387410 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-065ccb20-c389-40fa-a1ab-625dcb107afb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:44.388759 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-065ccb20-c389-40fa-a1ab-625dcb107afb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:44.389557 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-065ccb20-c389-40fa-a1ab-625dcb107afb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:44.426531 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-065ccb20-c389-40fa-a1ab-625dcb107afb tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054355 Jun 22 09:34:44.427741 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 878/1803] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:34:44 2022] GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 09:34:44.548976 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a581d0e7-704a-4595-8a36-2aa474e94ed4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:34:44.550013 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-a581d0e7-704a-4595-8a36-2aa474e94ed4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:34:44.563252 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a581d0e7-704a-4595-8a36-2aa474e94ed4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:44.564564 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a581d0e7-704a-4595-8a36-2aa474e94ed4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:44.565995 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a581d0e7-704a-4595-8a36-2aa474e94ed4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:44.567030 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a581d0e7-704a-4595-8a36-2aa474e94ed4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:44.600174 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a581d0e7-704a-4595-8a36-2aa474e94ed4 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056473 Jun 22 09:34:44.601119 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 926/1804] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:34:44 2022] GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 09:34:44.674547 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-9e9d0de0-4029-4661-9c29-aa59df87a963 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:34:44.675226 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-9e9d0de0-4029-4661-9c29-aa59df87a963 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:34:44.681719 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9e9d0de0-4029-4661-9c29-aa59df87a963 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:44.682977 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9e9d0de0-4029-4661-9c29-aa59df87a963 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:44.684104 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9e9d0de0-4029-4661-9c29-aa59df87a963 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:44.685631 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9e9d0de0-4029-4661-9c29-aa59df87a963 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:44.720446 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-9e9d0de0-4029-4661-9c29-aa59df87a963 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Going to try to terminate instance {{(pid=118024) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:34:45.247411 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-9e9d0de0-4029-4661-9c29-aa59df87a963 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836" status: 204 len: 0 microversion: 2.1 time: 0.578586 Jun 22 09:34:45.248627 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 879/1805] 10.222.0.16 () {58 vars in 1238 bytes} [Wed Jun 22 09:34:44 2022] DELETE /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:34:45.269133 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-70134878-0290-4b89-868f-f75ee55f980f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:34:45.269941 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-70134878-0290-4b89-868f-f75ee55f980f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:34:45.282855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-70134878-0290-4b89-868f-f75ee55f980f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:45.283685 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-70134878-0290-4b89-868f-f75ee55f980f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:45.288551 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-70134878-0290-4b89-868f-f75ee55f980f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:45.289413 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-70134878-0290-4b89-868f-f75ee55f980f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:45.501964 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-70134878-0290-4b89-868f-f75ee55f980f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:34:45.510858 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-70134878-0290-4b89-868f-f75ee55f980f tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836" status: 200 len: 1670 microversion: 2.1 time: 0.257547 Jun 22 09:34:45.512007 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 927/1806] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:34:45 2022] GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836 => generated 1670 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:34:46.532310 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-0e441202-9c78-420c-a9f1-6cc964012e56 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:34:46.534116 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-0e441202-9c78-420c-a9f1-6cc964012e56 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:34:46.541779 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0e441202-9c78-420c-a9f1-6cc964012e56 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:46.542526 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0e441202-9c78-420c-a9f1-6cc964012e56 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:46.543450 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0e441202-9c78-420c-a9f1-6cc964012e56 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:46.544748 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0e441202-9c78-420c-a9f1-6cc964012e56 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:46.713442 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-0e441202-9c78-420c-a9f1-6cc964012e56 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:34:46.722147 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-0e441202-9c78-420c-a9f1-6cc964012e56 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836" status: 200 len: 1670 microversion: 2.1 time: 0.195011 Jun 22 09:34:46.722807 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 880/1807] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:34:46 2022] GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836 => generated 1670 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:34:47.739789 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d5f274c9-0e62-409d-979e-310d807918f5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:34:47.740508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-d5f274c9-0e62-409d-979e-310d807918f5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:34:47.754011 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d5f274c9-0e62-409d-979e-310d807918f5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:47.754609 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d5f274c9-0e62-409d-979e-310d807918f5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:47.755465 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d5f274c9-0e62-409d-979e-310d807918f5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:47.756091 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d5f274c9-0e62-409d-979e-310d807918f5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:48.406626 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-d5f274c9-0e62-409d-979e-310d807918f5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:34:48.416595 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d5f274c9-0e62-409d-979e-310d807918f5 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836" status: 200 len: 1670 microversion: 2.1 time: 0.680841 Jun 22 09:34:48.417393 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 928/1808] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:34:47 2022] GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836 => generated 1670 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:34:49.012802 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [req-5ac3b3b2-8e1b-458b-9b64-e01f197eff29 req-3282e643-4a30-4d9f-b436-8022af7e41fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5963af0a-3ebd-4734-9c3e-d656a5ba9836", "name": "network-vif-deleted", "tag": "4a5add3d-5c67-4fe6-879f-fbd8949f599a"}]} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:34:49.022365 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-5ac3b3b2-8e1b-458b-9b64-e01f197eff29 req-3282e643-4a30-4d9f-b436-8022af7e41fa service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:49.022893 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-5ac3b3b2-8e1b-458b-9b64-e01f197eff29 req-3282e643-4a30-4d9f-b436-8022af7e41fa service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:49.038382 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.compute.server_external_events [req-5ac3b3b2-8e1b-458b-9b64-e01f197eff29 req-3282e643-4a30-4d9f-b436-8022af7e41fa service nova] Creating event network-vif-deleted:4a5add3d-5c67-4fe6-879f-fbd8949f599a for instance 5963af0a-3ebd-4734-9c3e-d656a5ba9836 on hv-cinder-84599 Jun 22 09:34:49.045136 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [req-5ac3b3b2-8e1b-458b-9b64-e01f197eff29 req-3282e643-4a30-4d9f-b436-8022af7e41fa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037645 Jun 22 09:34:49.045956 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 881/1809] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:34:49.435898 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-a679a2c6-c4ea-403d-88c3-3ac62c23f440 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:34:49.437718 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-a679a2c6-c4ea-403d-88c3-3ac62c23f440 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:34:49.450851 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a679a2c6-c4ea-403d-88c3-3ac62c23f440 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:49.451622 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a679a2c6-c4ea-403d-88c3-3ac62c23f440 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:49.452564 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a679a2c6-c4ea-403d-88c3-3ac62c23f440 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:49.453163 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-a679a2c6-c4ea-403d-88c3-3ac62c23f440 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:49.526837 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-a679a2c6-c4ea-403d-88c3-3ac62c23f440 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '566b001b7a504fadb85ad04ea1be22f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a336dc3fd44c2ae20e51b46d423e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:34:49.542982 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-a679a2c6-c4ea-403d-88c3-3ac62c23f440 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836" status: 200 len: 1321 microversion: 2.1 time: 0.112509 Jun 22 09:34:49.554932 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 929/1810] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:34:49 2022] GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836 => generated 1321 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:34:50.565309 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3f207614-edb9-4256-833c-9a76879de7d8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:34:50.565309 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3f207614-edb9-4256-833c-9a76879de7d8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:34:50.582473 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3f207614-edb9-4256-833c-9a76879de7d8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:50.587128 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3f207614-edb9-4256-833c-9a76879de7d8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:50.587128 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3f207614-edb9-4256-833c-9a76879de7d8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:50.587128 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3f207614-edb9-4256-833c-9a76879de7d8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:50.612798 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.wsgi [None req-3f207614-edb9-4256-833c-9a76879de7d8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] HTTP exception thrown: Instance 5963af0a-3ebd-4734-9c3e-d656a5ba9836 could not be found. Jun 22 09:34:50.626610 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3f207614-edb9-4256-833c-9a76879de7d8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Request method failure captured: Jun 22 09:34:50.626610 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: request: GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836 HTTP/1.1 Jun 22 09:34:50.626610 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept: application/json Jun 22 09:34:50.626610 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept-Encoding: identity Jun 22 09:34:50.626610 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Connection: close Jun 22 09:34:50.626610 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Length: 0 Jun 22 09:34:50.626610 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Type: application/json Jun 22 09:34:50.626610 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Host: 10.222.0.16 Jun 22 09:34:50.626610 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Openstack-System-Scope: None Jun 22 09:34:50.626610 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: User-Agent: python-urllib3/1.26.9 Jun 22 09:34:50.626610 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Auth-Token: gAAAAABistmkfOwtY0Mqgvv4OFOXEqJ-XW6pJ2f84nimnN53ncl2QdYWmtjdiRm2zgxbQHXkiGOey7s4qzXWrbuoBF4DOmC2nXSKzH8o2Vj6BjbS46c0wt_ueRXzz--E9e6LsrsawIvB4hMRGF5qW0g-qUzFeOlraumTqcGCCIL_Ekz2n58lGyk Jun 22 09:34:50.626610 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Id: None Jun 22 09:34:50.626610 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Name: None Jun 22 09:34:50.626610 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Identity-Status: Confirmed Jun 22 09:34:50.626610 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Is-Admin-Project: True Jun 22 09:34:50.626610 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Id: default Jun 22 09:34:50.626610 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Name: Default Jun 22 09:34:50.626610 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Id: 175a336dc3fd44c2ae20e51b46d423e4 Jun 22 09:34:50.626610 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Name: tempest-AttachVolumeTestJSON-2143630622 Jun 22 09:34:50.626610 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Role: member,reader Jun 22 09:34:50.626610 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Roles: member,reader Jun 22 09:34:50.627967 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/175a336dc3fd44c2ae20e51b46d423e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/175a336dc3fd44c2ae20e51b46d423e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/175a336dc3fd44c2ae20e51b46d423e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_175a336dc3fd44c2ae20e51b46d423e4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:34:50.627967 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant: tempest-AttachVolumeTestJSON-2143630622 Jun 22 09:34:50.627967 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Id: 175a336dc3fd44c2ae20e51b46d423e4 Jun 22 09:34:50.627967 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2143630622 Jun 22 09:34:50.627967 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User: tempest-AttachVolumeTestJSON-2143630622-project Jun 22 09:34:50.627967 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Id: default Jun 22 09:34:50.627967 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Name: Default Jun 22 09:34:50.627967 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Id: 566b001b7a504fadb85ad04ea1be22f2 Jun 22 09:34:50.627967 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Name: tempest-AttachVolumeTestJSON-2143630622-project Jun 22 09:34:50.627967 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: method: > Jun 22 09:34:50.627967 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: exception: Instance 5963af0a-3ebd-4734-9c3e-d656a5ba9836 could not be found. Jun 22 09:34:50.627967 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: action_args: {'id': '5963af0a-3ebd-4734-9c3e-d656a5ba9836'} Jun 22 09:34:50.628916 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:34:50.628916 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:34:50.628916 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:34:50.628916 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:34:50.628916 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:34:50.628916 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:34:50.628916 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:34:50.628916 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:34:50.628916 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:34:50.628916 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:34:50.628916 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5963af0a-3ebd-4734-9c3e-d656a5ba9836 could not be found. Jun 22 09:34:50.628916 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:34:50.628916 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:34:50.628916 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:34:50.628916 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:34:50.628916 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:34:50.628916 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:34:50.628916 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:34:50.628916 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:34:50.628916 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:34:50.629965 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:34:50.629965 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:34:50.629965 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:34:50.629965 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:34:50.629965 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:34:50.629965 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:34:50.629965 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:34:50.629965 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5963af0a-3ebd-4734-9c3e-d656a5ba9836 could not be found. Jun 22 09:34:50.629965 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:34:50.629965 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:34:50.629965 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:34:50.629965 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:34:50.629965 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:34:50.629965 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:34:50.629965 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:34:50.629965 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:34:50.629965 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5963af0a-3ebd-4734-9c3e-d656a5ba9836 could not be found. Jun 22 09:34:50.629965 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:34:50.630921 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3f207614-edb9-4256-833c-9a76879de7d8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Returning 404 to user: Instance 5963af0a-3ebd-4734-9c3e-d656a5ba9836 could not be found. {{(pid=118024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:34:50.630987 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3f207614-edb9-4256-833c-9a76879de7d8 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836" status: 404 len: 111 microversion: 2.1 time: 0.073401 Jun 22 09:34:50.631912 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 882/1811] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:34:50 2022] GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:34:50.645824 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-569a1d78-1b02-4724-b9e4-abe2332fc4bd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '.version_select at 0x7f5756466ee0>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:34:50.830135 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-569a1d78-1b02-4724-b9e4-abe2332fc4bd tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-315021321" status: 202 len: 0 microversion: 2.1 time: 0.192871 Jun 22 09:34:50.836013 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 930/1812] 10.222.0.16 () {58 vars in 1217 bytes} [Wed Jun 22 09:34:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-315021321 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:34:56.542572 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3af68614-7ef5-4bfe-bce8-df2ef15def10 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:34:56.545683 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3af68614-7ef5-4bfe-bce8-df2ef15def10 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:34:56.558219 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3af68614-7ef5-4bfe-bce8-df2ef15def10 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:56.558740 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3af68614-7ef5-4bfe-bce8-df2ef15def10 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:56.560042 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3af68614-7ef5-4bfe-bce8-df2ef15def10 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:56.560691 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3af68614-7ef5-4bfe-bce8-df2ef15def10 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:56.575951 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.wsgi [None req-3af68614-7ef5-4bfe-bce8-df2ef15def10 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] HTTP exception thrown: Instance 5963af0a-3ebd-4734-9c3e-d656a5ba9836 could not be found. Jun 22 09:34:56.578173 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3af68614-7ef5-4bfe-bce8-df2ef15def10 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Request method failure captured: Jun 22 09:34:56.578173 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: request: DELETE /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836 HTTP/1.1 Jun 22 09:34:56.578173 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept: application/json Jun 22 09:34:56.578173 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept-Encoding: identity Jun 22 09:34:56.578173 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Connection: close Jun 22 09:34:56.578173 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Length: 0 Jun 22 09:34:56.578173 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Type: application/json Jun 22 09:34:56.578173 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Host: 10.222.0.16 Jun 22 09:34:56.578173 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Openstack-System-Scope: None Jun 22 09:34:56.578173 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: User-Agent: python-urllib3/1.26.9 Jun 22 09:34:56.578173 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Auth-Token: gAAAAABistmkfOwtY0Mqgvv4OFOXEqJ-XW6pJ2f84nimnN53ncl2QdYWmtjdiRm2zgxbQHXkiGOey7s4qzXWrbuoBF4DOmC2nXSKzH8o2Vj6BjbS46c0wt_ueRXzz--E9e6LsrsawIvB4hMRGF5qW0g-qUzFeOlraumTqcGCCIL_Ekz2n58lGyk Jun 22 09:34:56.578173 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Id: None Jun 22 09:34:56.578173 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Name: None Jun 22 09:34:56.578173 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Identity-Status: Confirmed Jun 22 09:34:56.578173 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Is-Admin-Project: True Jun 22 09:34:56.578173 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Id: default Jun 22 09:34:56.578173 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Name: Default Jun 22 09:34:56.578173 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Id: 175a336dc3fd44c2ae20e51b46d423e4 Jun 22 09:34:56.578173 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Name: tempest-AttachVolumeTestJSON-2143630622 Jun 22 09:34:56.578173 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Role: member,reader Jun 22 09:34:56.578173 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Roles: member,reader Jun 22 09:34:56.579582 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/175a336dc3fd44c2ae20e51b46d423e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/175a336dc3fd44c2ae20e51b46d423e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/175a336dc3fd44c2ae20e51b46d423e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_175a336dc3fd44c2ae20e51b46d423e4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:34:56.579582 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant: tempest-AttachVolumeTestJSON-2143630622 Jun 22 09:34:56.579582 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Id: 175a336dc3fd44c2ae20e51b46d423e4 Jun 22 09:34:56.579582 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2143630622 Jun 22 09:34:56.579582 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User: tempest-AttachVolumeTestJSON-2143630622-project Jun 22 09:34:56.579582 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Id: default Jun 22 09:34:56.579582 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Name: Default Jun 22 09:34:56.579582 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Id: 566b001b7a504fadb85ad04ea1be22f2 Jun 22 09:34:56.579582 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Name: tempest-AttachVolumeTestJSON-2143630622-project Jun 22 09:34:56.579582 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: method: > Jun 22 09:34:56.579582 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: exception: Instance 5963af0a-3ebd-4734-9c3e-d656a5ba9836 could not be found. Jun 22 09:34:56.579582 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: action_args: {'id': '5963af0a-3ebd-4734-9c3e-d656a5ba9836'} Jun 22 09:34:56.580259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:34:56.580259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:34:56.580259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:34:56.580259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:34:56.580259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:34:56.580259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:34:56.580259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:34:56.580259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:34:56.580259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:34:56.580259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:34:56.580259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5963af0a-3ebd-4734-9c3e-d656a5ba9836 could not be found. Jun 22 09:34:56.580259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:34:56.580259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:34:56.580259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:34:56.580259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:34:56.580259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:34:56.580259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:34:56.580259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:34:56.580259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:34:56.580259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:34:56.581533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:34:56.581533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 09:34:56.581533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 09:34:56.581533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 09:34:56.581533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 09:34:56.581533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:34:56.581533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:34:56.581533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:34:56.581533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:34:56.581533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5963af0a-3ebd-4734-9c3e-d656a5ba9836 could not be found. Jun 22 09:34:56.581533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:34:56.581533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:34:56.581533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:34:56.581533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:34:56.581533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:34:56.581533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:34:56.581533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:34:56.581533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:34:56.581533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5963af0a-3ebd-4734-9c3e-d656a5ba9836 could not be found. Jun 22 09:34:56.581533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:34:56.582770 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3af68614-7ef5-4bfe-bce8-df2ef15def10 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Returning 404 to user: Instance 5963af0a-3ebd-4734-9c3e-d656a5ba9836 could not be found. {{(pid=118024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:34:56.583006 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3af68614-7ef5-4bfe-bce8-df2ef15def10 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836" status: 404 len: 111 microversion: 2.1 time: 0.046917 Jun 22 09:34:56.583823 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 883/1813] 10.222.0.16 () {58 vars in 1238 bytes} [Wed Jun 22 09:34:56 2022] DELETE /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:34:56.597555 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-04fbf5e4-e585-492a-941c-be734785e669 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:34:56.610824 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-04fbf5e4-e585-492a-941c-be734785e669 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: 5963af0a-3ebd-4734-9c3e-d656a5ba9836] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:34:56.610824 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-04fbf5e4-e585-492a-941c-be734785e669 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:56.610824 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-04fbf5e4-e585-492a-941c-be734785e669 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:56.611443 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-04fbf5e4-e585-492a-941c-be734785e669 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:34:56.612026 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-04fbf5e4-e585-492a-941c-be734785e669 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:34:56.632072 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.wsgi [None req-04fbf5e4-e585-492a-941c-be734785e669 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] HTTP exception thrown: Instance 5963af0a-3ebd-4734-9c3e-d656a5ba9836 could not be found. Jun 22 09:34:56.633804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-04fbf5e4-e585-492a-941c-be734785e669 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Request method failure captured: Jun 22 09:34:56.633804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: request: GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836 HTTP/1.1 Jun 22 09:34:56.633804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept: application/json Jun 22 09:34:56.633804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept-Encoding: identity Jun 22 09:34:56.633804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Connection: close Jun 22 09:34:56.633804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Length: 0 Jun 22 09:34:56.633804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Type: application/json Jun 22 09:34:56.633804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Host: 10.222.0.16 Jun 22 09:34:56.633804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Openstack-System-Scope: None Jun 22 09:34:56.633804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: User-Agent: python-urllib3/1.26.9 Jun 22 09:34:56.633804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Auth-Token: gAAAAABistmkfOwtY0Mqgvv4OFOXEqJ-XW6pJ2f84nimnN53ncl2QdYWmtjdiRm2zgxbQHXkiGOey7s4qzXWrbuoBF4DOmC2nXSKzH8o2Vj6BjbS46c0wt_ueRXzz--E9e6LsrsawIvB4hMRGF5qW0g-qUzFeOlraumTqcGCCIL_Ekz2n58lGyk Jun 22 09:34:56.633804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Id: None Jun 22 09:34:56.633804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Name: None Jun 22 09:34:56.633804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Identity-Status: Confirmed Jun 22 09:34:56.633804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Is-Admin-Project: True Jun 22 09:34:56.633804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Id: default Jun 22 09:34:56.633804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Name: Default Jun 22 09:34:56.633804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Id: 175a336dc3fd44c2ae20e51b46d423e4 Jun 22 09:34:56.633804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Name: tempest-AttachVolumeTestJSON-2143630622 Jun 22 09:34:56.633804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Role: member,reader Jun 22 09:34:56.633804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Roles: member,reader Jun 22 09:34:56.635088 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/175a336dc3fd44c2ae20e51b46d423e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/175a336dc3fd44c2ae20e51b46d423e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/175a336dc3fd44c2ae20e51b46d423e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_175a336dc3fd44c2ae20e51b46d423e4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:34:56.635088 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant: tempest-AttachVolumeTestJSON-2143630622 Jun 22 09:34:56.635088 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Id: 175a336dc3fd44c2ae20e51b46d423e4 Jun 22 09:34:56.635088 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2143630622 Jun 22 09:34:56.635088 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User: tempest-AttachVolumeTestJSON-2143630622-project Jun 22 09:34:56.635088 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Id: default Jun 22 09:34:56.635088 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Name: Default Jun 22 09:34:56.635088 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Id: 566b001b7a504fadb85ad04ea1be22f2 Jun 22 09:34:56.635088 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Name: tempest-AttachVolumeTestJSON-2143630622-project Jun 22 09:34:56.635088 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: method: > Jun 22 09:34:56.635088 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: exception: Instance 5963af0a-3ebd-4734-9c3e-d656a5ba9836 could not be found. Jun 22 09:34:56.635088 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: action_args: {'id': '5963af0a-3ebd-4734-9c3e-d656a5ba9836'} Jun 22 09:34:56.635807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:34:56.635807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:34:56.635807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:34:56.635807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:34:56.635807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:34:56.635807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:34:56.635807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:34:56.635807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:34:56.635807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:34:56.635807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:34:56.635807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5963af0a-3ebd-4734-9c3e-d656a5ba9836 could not be found. Jun 22 09:34:56.635807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:34:56.635807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:34:56.635807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:34:56.635807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:34:56.635807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:34:56.635807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:34:56.635807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:34:56.635807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:34:56.635807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:34:56.636823 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:34:56.636823 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:34:56.636823 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:34:56.636823 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:34:56.636823 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:34:56.636823 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:34:56.636823 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:34:56.636823 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5963af0a-3ebd-4734-9c3e-d656a5ba9836 could not be found. Jun 22 09:34:56.636823 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:34:56.636823 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:34:56.636823 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:34:56.636823 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:34:56.636823 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:34:56.636823 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:34:56.636823 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:34:56.636823 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:34:56.636823 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5963af0a-3ebd-4734-9c3e-d656a5ba9836 could not be found. Jun 22 09:34:56.636823 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:34:56.643029 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-04fbf5e4-e585-492a-941c-be734785e669 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Returning 404 to user: Instance 5963af0a-3ebd-4734-9c3e-d656a5ba9836 could not be found. {{(pid=118025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:34:56.643029 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-04fbf5e4-e585-492a-941c-be734785e669 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836" status: 404 len: 111 microversion: 2.1 time: 0.045809 Jun 22 09:34:56.643029 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 931/1814] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:34:56 2022] GET /compute/v2.1/servers/5963af0a-3ebd-4734-9c3e-d656a5ba9836 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:34:59.228232 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:34:59.229225 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Wed Jun 22 09:34:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:35:08.923656 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-645a12d6-35e1-4410-bb92-640420eacb43 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Action: 'create', calling method: .version_select at 0x7f5756afb8b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1287086065", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQfxdeyhnBtTzmyaZcbqGFtpgJs/4MCEXTR7bQNylsvj3CcbeOl4Ct0/ySbzh1jEMH8gi/sod3bRX4GT4veCervPueWiU27pHdXYFFJLmds7XWdJ1U6suNgT/oqshGKrQ=="}} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:35:08.928235 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:35:08.928929 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:35:08.940151 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.quota [None req-645a12d6-35e1-4410-bb92-640420eacb43 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Getting quotas for project 8c5252320d824d608d9ac574bf61dcc5. Resources: {'key_pairs'} {{(pid=118024) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:35:08.945048 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.quota [None req-645a12d6-35e1-4410-bb92-640420eacb43 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Getting quotas for user 8426e9386439471c89880a2ef9eee2fa and project 8c5252320d824d608d9ac574bf61dcc5. Resources: {'key_pairs'} {{(pid=118024) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:35:09.136087 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-645a12d6-35e1-4410-bb92-640420eacb43 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.216216 Jun 22 09:35:09.136673 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 884/1815] 10.222.0.16 () {60 vars in 1158 bytes} [Wed Jun 22 09:35:08 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:35:09.240759 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-58a035e8-444c-44ea-a01b-c8909aba1b48 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1415473523", "imageRef": "c4b4535f-1d9a-4146-a39e-5d2dccd41f42", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1287086065", "networks": [{"uuid": "c2802377-c676-4e7a-a7f5-35d8da0e7fb5"}]}} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:35:09.248148 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:35:09.248827 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=56,nova_cell1:INSERT=2 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:35:09.568569 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.network.neutron [None req-58a035e8-444c-44ea-a01b-c8909aba1b48 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] validate_networks() for [('c2802377-c676-4e7a-a7f5-35d8da0e7fb5', None, None, None, None, None)] {{(pid=118025) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:35:10.050752 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-58a035e8-444c-44ea-a01b-c8909aba1b48 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Flavor limits 0:0:0 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:35:10.051180 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-58a035e8-444c-44ea-a01b-c8909aba1b48 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Image limits 0:0:0 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:35:10.051661 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-58a035e8-444c-44ea-a01b-c8909aba1b48 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Flavor pref 0:0:0 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:35:10.052071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-58a035e8-444c-44ea-a01b-c8909aba1b48 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Image pref 0:0:0 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:35:10.052496 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-58a035e8-444c-44ea-a01b-c8909aba1b48 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:35:10.062423 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-58a035e8-444c-44ea-a01b-c8909aba1b48 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:10.062878 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-58a035e8-444c-44ea-a01b-c8909aba1b48 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:10.063727 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-58a035e8-444c-44ea-a01b-c8909aba1b48 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:10.064168 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-58a035e8-444c-44ea-a01b-c8909aba1b48 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:10.081495 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.quota [None req-58a035e8-444c-44ea-a01b-c8909aba1b48 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Getting quotas for project 8c5252320d824d608d9ac574bf61dcc5. Resources: {'cores', 'instances', 'ram'} {{(pid=118025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:35:10.085573 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.quota [None req-58a035e8-444c-44ea-a01b-c8909aba1b48 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Getting quotas for user 8426e9386439471c89880a2ef9eee2fa and project 8c5252320d824d608d9ac574bf61dcc5. Resources: {'cores', 'instances', 'ram'} {{(pid=118025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:35:10.098306 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-58a035e8-444c-44ea-a01b-c8909aba1b48 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Going to run 1 instances... {{(pid=118025) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:35:10.102620 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-58a035e8-444c-44ea-a01b-c8909aba1b48 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4b4535f-1d9a-4146-a39e-5d2dccd41f42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:35:10.241569 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-58a035e8-444c-44ea-a01b-c8909aba1b48 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.004756 Jun 22 09:35:10.242291 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 932/1816] 10.222.0.16 () {60 vars in 1146 bytes} [Wed Jun 22 09:35:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:35:10.253536 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ad8bb7c1-916d-4c25-ae97-f818c0a7f425 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:10.254221 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ad8bb7c1-916d-4c25-ae97-f818c0a7f425 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:10.316223 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ad8bb7c1-916d-4c25-ae97-f818c0a7f425 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:10.323551 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ad8bb7c1-916d-4c25-ae97-f818c0a7f425 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1259 microversion: 2.1 time: 0.074986 Jun 22 09:35:10.324965 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 885/1817] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:10 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1259 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:35:11.341529 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9ff4f7af-fbc8-4b17-afff-de1e39b60140 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:11.342399 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9ff4f7af-fbc8-4b17-afff-de1e39b60140 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:11.425060 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9ff4f7af-fbc8-4b17-afff-de1e39b60140 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:11.433428 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9ff4f7af-fbc8-4b17-afff-de1e39b60140 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1259 microversion: 2.1 time: 0.095498 Jun 22 09:35:11.434135 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 933/1818] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:11 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1259 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:35:12.450328 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f1a769ab-e201-474e-863b-bb389dd6e047 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:12.451186 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f1a769ab-e201-474e-863b-bb389dd6e047 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:12.459553 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f1a769ab-e201-474e-863b-bb389dd6e047 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:12.460005 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f1a769ab-e201-474e-863b-bb389dd6e047 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:12.460795 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f1a769ab-e201-474e-863b-bb389dd6e047 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:12.461248 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f1a769ab-e201-474e-863b-bb389dd6e047 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:12.528434 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-f1a769ab-e201-474e-863b-bb389dd6e047 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:12.536486 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f1a769ab-e201-474e-863b-bb389dd6e047 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1263 microversion: 2.1 time: 0.090052 Jun 22 09:35:12.537111 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 886/1819] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:12 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1263 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:35:13.553176 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-bc501261-ec43-4981-b2df-eaf434457f4a tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:13.553718 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-bc501261-ec43-4981-b2df-eaf434457f4a tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:13.561582 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bc501261-ec43-4981-b2df-eaf434457f4a tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:13.562040 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bc501261-ec43-4981-b2df-eaf434457f4a tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:13.562835 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bc501261-ec43-4981-b2df-eaf434457f4a tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:13.563431 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bc501261-ec43-4981-b2df-eaf434457f4a tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:13.630195 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-bc501261-ec43-4981-b2df-eaf434457f4a tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:13.638022 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-bc501261-ec43-4981-b2df-eaf434457f4a tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1263 microversion: 2.1 time: 0.088796 Jun 22 09:35:13.638608 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 934/1820] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:13 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1263 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:35:14.654977 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-360f2bdc-0f9c-49ab-98d0-0aaee688ff64 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:14.655505 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-360f2bdc-0f9c-49ab-98d0-0aaee688ff64 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:14.662562 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-360f2bdc-0f9c-49ab-98d0-0aaee688ff64 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:14.663005 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-360f2bdc-0f9c-49ab-98d0-0aaee688ff64 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:14.663770 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-360f2bdc-0f9c-49ab-98d0-0aaee688ff64 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:14.664271 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-360f2bdc-0f9c-49ab-98d0-0aaee688ff64 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:14.726185 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-360f2bdc-0f9c-49ab-98d0-0aaee688ff64 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:14.734686 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-360f2bdc-0f9c-49ab-98d0-0aaee688ff64 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1263 microversion: 2.1 time: 0.084411 Jun 22 09:35:14.737601 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 887/1821] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:14 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1263 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:35:15.752608 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-43c10c8b-3c5c-4041-9b82-caa26412aac2 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:15.753301 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-43c10c8b-3c5c-4041-9b82-caa26412aac2 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:15.760438 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-43c10c8b-3c5c-4041-9b82-caa26412aac2 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:15.761807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-43c10c8b-3c5c-4041-9b82-caa26412aac2 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:15.762591 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-43c10c8b-3c5c-4041-9b82-caa26412aac2 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:15.763034 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-43c10c8b-3c5c-4041-9b82-caa26412aac2 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:15.835898 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-43c10c8b-3c5c-4041-9b82-caa26412aac2 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:15.845990 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-43c10c8b-3c5c-4041-9b82-caa26412aac2 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1263 microversion: 2.1 time: 0.097361 Jun 22 09:35:15.846654 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 935/1822] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:15 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1263 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:35:16.863536 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-885ba86d-5211-4617-bd4f-47fa5980a8cc tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:16.864178 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-885ba86d-5211-4617-bd4f-47fa5980a8cc tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:16.871262 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-885ba86d-5211-4617-bd4f-47fa5980a8cc tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:16.871710 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-885ba86d-5211-4617-bd4f-47fa5980a8cc tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:16.872524 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-885ba86d-5211-4617-bd4f-47fa5980a8cc tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:16.873008 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-885ba86d-5211-4617-bd4f-47fa5980a8cc tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:16.949910 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-885ba86d-5211-4617-bd4f-47fa5980a8cc tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:16.958065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-885ba86d-5211-4617-bd4f-47fa5980a8cc tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1311 microversion: 2.1 time: 0.098308 Jun 22 09:35:16.958695 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 888/1823] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:16 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:35:17.979197 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-bad02649-7f5f-4a66-a9d9-a9529f95709f tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:17.979197 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-bad02649-7f5f-4a66-a9d9-a9529f95709f tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:17.992350 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bad02649-7f5f-4a66-a9d9-a9529f95709f tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:17.993023 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bad02649-7f5f-4a66-a9d9-a9529f95709f tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:17.993965 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bad02649-7f5f-4a66-a9d9-a9529f95709f tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:17.994554 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bad02649-7f5f-4a66-a9d9-a9529f95709f tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:18.168155 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-bad02649-7f5f-4a66-a9d9-a9529f95709f tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:18.179390 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-bad02649-7f5f-4a66-a9d9-a9529f95709f tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1359 microversion: 2.1 time: 0.204121 Jun 22 09:35:18.179390 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 936/1824] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:17 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1359 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:35:19.194336 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-f5a58fa8-0e0d-4a7a-b514-5ab5a75302ca tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:19.194959 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-f5a58fa8-0e0d-4a7a-b514-5ab5a75302ca tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:19.202545 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f5a58fa8-0e0d-4a7a-b514-5ab5a75302ca tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:19.202989 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f5a58fa8-0e0d-4a7a-b514-5ab5a75302ca tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:19.203753 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f5a58fa8-0e0d-4a7a-b514-5ab5a75302ca tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:19.204188 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-f5a58fa8-0e0d-4a7a-b514-5ab5a75302ca tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:19.372438 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-f5a58fa8-0e0d-4a7a-b514-5ab5a75302ca tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:19.379979 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-f5a58fa8-0e0d-4a7a-b514-5ab5a75302ca tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1359 microversion: 2.1 time: 0.189615 Jun 22 09:35:19.380885 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 889/1825] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:19 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:35:20.397496 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7b382bbb-c75f-4de1-a842-f44b9c7cef81 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:20.407921 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7b382bbb-c75f-4de1-a842-f44b9c7cef81 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:20.407921 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell0:SELECT=2 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:35:20.407921 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7b382bbb-c75f-4de1-a842-f44b9c7cef81 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:20.407921 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7b382bbb-c75f-4de1-a842-f44b9c7cef81 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:20.408284 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7b382bbb-c75f-4de1-a842-f44b9c7cef81 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:20.408284 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7b382bbb-c75f-4de1-a842-f44b9c7cef81 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:20.553358 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7b382bbb-c75f-4de1-a842-f44b9c7cef81 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:20.565846 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7b382bbb-c75f-4de1-a842-f44b9c7cef81 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1359 microversion: 2.1 time: 0.172638 Jun 22 09:35:20.566438 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 937/1826] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:20 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:35:21.583717 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-be4f8868-86af-48f0-ac1a-5dfa20870f69 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:21.584551 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-be4f8868-86af-48f0-ac1a-5dfa20870f69 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:21.587030 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell0:SELECT=6 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:35:21.599004 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-be4f8868-86af-48f0-ac1a-5dfa20870f69 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:21.599004 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-be4f8868-86af-48f0-ac1a-5dfa20870f69 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:21.599004 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-be4f8868-86af-48f0-ac1a-5dfa20870f69 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:21.599004 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-be4f8868-86af-48f0-ac1a-5dfa20870f69 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:21.983016 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-be4f8868-86af-48f0-ac1a-5dfa20870f69 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:21.991093 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-be4f8868-86af-48f0-ac1a-5dfa20870f69 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1359 microversion: 2.1 time: 0.411565 Jun 22 09:35:21.991883 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 890/1827] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:21 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1359 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:35:23.037118 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-93906d24-3f5f-4e67-afe3-2c48401a7df7 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:23.037118 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-93906d24-3f5f-4e67-afe3-2c48401a7df7 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:23.037118 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell0:SELECT=8 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:35:23.037118 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-93906d24-3f5f-4e67-afe3-2c48401a7df7 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:23.037118 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-93906d24-3f5f-4e67-afe3-2c48401a7df7 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:23.037997 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-93906d24-3f5f-4e67-afe3-2c48401a7df7 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:23.037997 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-93906d24-3f5f-4e67-afe3-2c48401a7df7 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:23.199837 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-93906d24-3f5f-4e67-afe3-2c48401a7df7 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:23.208248 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-93906d24-3f5f-4e67-afe3-2c48401a7df7 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1359 microversion: 2.1 time: 0.203710 Jun 22 09:35:23.208846 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 938/1828] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:23 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1359 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:35:24.226335 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-7e198c0c-d747-45a1-85c2-e940b02429a5 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:24.227622 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-7e198c0c-d747-45a1-85c2-e940b02429a5 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:24.241496 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7e198c0c-d747-45a1-85c2-e940b02429a5 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:24.241496 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7e198c0c-d747-45a1-85c2-e940b02429a5 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:24.241496 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7e198c0c-d747-45a1-85c2-e940b02429a5 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:24.241496 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7e198c0c-d747-45a1-85c2-e940b02429a5 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:24.405143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-7e198c0c-d747-45a1-85c2-e940b02429a5 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:24.405143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-7e198c0c-d747-45a1-85c2-e940b02429a5 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1359 microversion: 2.1 time: 0.181669 Jun 22 09:35:24.405143 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 891/1829] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:24 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:35:25.424372 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-37782659-2581-4caa-ba74-b69571a24d2f tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:25.428567 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-37782659-2581-4caa-ba74-b69571a24d2f tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:25.433840 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-37782659-2581-4caa-ba74-b69571a24d2f tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:25.434322 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-37782659-2581-4caa-ba74-b69571a24d2f tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:25.435201 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-37782659-2581-4caa-ba74-b69571a24d2f tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:25.435681 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-37782659-2581-4caa-ba74-b69571a24d2f tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:25.597215 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-37782659-2581-4caa-ba74-b69571a24d2f tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:25.608204 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-37782659-2581-4caa-ba74-b69571a24d2f tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1359 microversion: 2.1 time: 0.187631 Jun 22 09:35:25.609735 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 939/1830] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:25 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:35:26.630091 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1474aa9b-23f4-48bc-a6bc-dd0445046f7e tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:26.630723 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1474aa9b-23f4-48bc-a6bc-dd0445046f7e tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:26.637144 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1474aa9b-23f4-48bc-a6bc-dd0445046f7e tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:26.637590 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1474aa9b-23f4-48bc-a6bc-dd0445046f7e tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:26.638353 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1474aa9b-23f4-48bc-a6bc-dd0445046f7e tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:26.638784 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1474aa9b-23f4-48bc-a6bc-dd0445046f7e tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:26.783851 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-1474aa9b-23f4-48bc-a6bc-dd0445046f7e tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:26.794174 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1474aa9b-23f4-48bc-a6bc-dd0445046f7e tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1359 microversion: 2.1 time: 0.167925 Jun 22 09:35:26.801375 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 892/1831] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:26 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:35:27.813307 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2d26792d-4dd3-42f6-a703-a9c0e22a8d84 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:27.813961 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2d26792d-4dd3-42f6-a703-a9c0e22a8d84 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:27.821034 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2d26792d-4dd3-42f6-a703-a9c0e22a8d84 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:27.821484 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2d26792d-4dd3-42f6-a703-a9c0e22a8d84 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:27.822263 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2d26792d-4dd3-42f6-a703-a9c0e22a8d84 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:27.822703 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2d26792d-4dd3-42f6-a703-a9c0e22a8d84 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:28.070928 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-2d26792d-4dd3-42f6-a703-a9c0e22a8d84 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:28.070928 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2d26792d-4dd3-42f6-a703-a9c0e22a8d84 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1359 microversion: 2.1 time: 0.223632 Jun 22 09:35:28.070928 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 940/1832] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:27 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:35:29.097536 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-323009f6-e038-4412-81ad-2529b00f3319 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:29.098967 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-323009f6-e038-4412-81ad-2529b00f3319 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:29.113926 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-323009f6-e038-4412-81ad-2529b00f3319 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:29.114585 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-323009f6-e038-4412-81ad-2529b00f3319 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:29.115451 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-323009f6-e038-4412-81ad-2529b00f3319 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:29.116000 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-323009f6-e038-4412-81ad-2529b00f3319 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:29.308451 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-323009f6-e038-4412-81ad-2529b00f3319 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:29.317018 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-323009f6-e038-4412-81ad-2529b00f3319 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1359 microversion: 2.1 time: 0.226056 Jun 22 09:35:29.317594 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 893/1833] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:29 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:35:30.342495 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-284776d4-e924-48c0-a2fb-eb109ae0aabe tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:30.343271 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-284776d4-e924-48c0-a2fb-eb109ae0aabe tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:30.353192 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-284776d4-e924-48c0-a2fb-eb109ae0aabe tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:30.357809 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-284776d4-e924-48c0-a2fb-eb109ae0aabe tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:30.357809 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-284776d4-e924-48c0-a2fb-eb109ae0aabe tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:30.357809 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-284776d4-e924-48c0-a2fb-eb109ae0aabe tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:30.503369 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-284776d4-e924-48c0-a2fb-eb109ae0aabe tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:30.513437 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-284776d4-e924-48c0-a2fb-eb109ae0aabe tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1359 microversion: 2.1 time: 0.175586 Jun 22 09:35:30.514132 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 941/1834] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:30 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:35:31.531472 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-8824b41f-60fa-4d73-8d5e-bc044562b976 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:31.532513 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-8824b41f-60fa-4d73-8d5e-bc044562b976 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:31.540391 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8824b41f-60fa-4d73-8d5e-bc044562b976 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:31.540911 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8824b41f-60fa-4d73-8d5e-bc044562b976 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:31.541685 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8824b41f-60fa-4d73-8d5e-bc044562b976 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:31.542124 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8824b41f-60fa-4d73-8d5e-bc044562b976 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:31.683374 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-8824b41f-60fa-4d73-8d5e-bc044562b976 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:31.691113 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-8824b41f-60fa-4d73-8d5e-bc044562b976 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1359 microversion: 2.1 time: 0.164096 Jun 22 09:35:31.691718 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 894/1835] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:31 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:35:32.708263 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-677943a9-6c80-49fc-8edc-c85683899cba tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:32.708937 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-677943a9-6c80-49fc-8edc-c85683899cba tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:32.716574 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-677943a9-6c80-49fc-8edc-c85683899cba tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:32.717355 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-677943a9-6c80-49fc-8edc-c85683899cba tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:32.718122 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-677943a9-6c80-49fc-8edc-c85683899cba tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:32.718557 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-677943a9-6c80-49fc-8edc-c85683899cba tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:32.856578 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-677943a9-6c80-49fc-8edc-c85683899cba tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:32.864143 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-677943a9-6c80-49fc-8edc-c85683899cba tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1359 microversion: 2.1 time: 0.160347 Jun 22 09:35:32.864702 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 942/1836] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:32 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:35:33.880832 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-4cb63fa0-ce2b-4bb3-9e3e-afe8c2d62e4d tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:33.883409 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-4cb63fa0-ce2b-4bb3-9e3e-afe8c2d62e4d tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:33.889205 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4cb63fa0-ce2b-4bb3-9e3e-afe8c2d62e4d tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:33.889658 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4cb63fa0-ce2b-4bb3-9e3e-afe8c2d62e4d tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:33.890445 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4cb63fa0-ce2b-4bb3-9e3e-afe8c2d62e4d tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:33.890890 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4cb63fa0-ce2b-4bb3-9e3e-afe8c2d62e4d tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:34.027672 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-4cb63fa0-ce2b-4bb3-9e3e-afe8c2d62e4d tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:34.036663 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-4cb63fa0-ce2b-4bb3-9e3e-afe8c2d62e4d tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1359 microversion: 2.1 time: 0.159784 Jun 22 09:35:34.037539 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 895/1837] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:33 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:35:35.055301 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-bb88546e-13c8-450d-95ac-2abc952f215b tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:35.062807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-bb88546e-13c8-450d-95ac-2abc952f215b tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:35.062934 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bb88546e-13c8-450d-95ac-2abc952f215b tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:35.063420 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bb88546e-13c8-450d-95ac-2abc952f215b tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:35.064285 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bb88546e-13c8-450d-95ac-2abc952f215b tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:35.064724 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-bb88546e-13c8-450d-95ac-2abc952f215b tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:35.202761 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-bb88546e-13c8-450d-95ac-2abc952f215b tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:35.211687 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-bb88546e-13c8-450d-95ac-2abc952f215b tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1359 microversion: 2.1 time: 0.159263 Jun 22 09:35:35.211687 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 943/1838] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:35 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:35:36.229404 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-d8282340-9992-4379-859e-e8579b0e9797 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:36.230226 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-d8282340-9992-4379-859e-e8579b0e9797 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:36.238741 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d8282340-9992-4379-859e-e8579b0e9797 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:36.239261 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d8282340-9992-4379-859e-e8579b0e9797 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:36.240390 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d8282340-9992-4379-859e-e8579b0e9797 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:36.240858 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d8282340-9992-4379-859e-e8579b0e9797 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:36.384548 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-d8282340-9992-4379-859e-e8579b0e9797 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:36.393545 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-d8282340-9992-4379-859e-e8579b0e9797 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1359 microversion: 2.1 time: 0.168341 Jun 22 09:35:36.394079 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 896/1839] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:36 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:35:37.411548 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c17bc302-7f96-4ef1-803f-38908081e9ad tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:37.412163 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c17bc302-7f96-4ef1-803f-38908081e9ad tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:37.418264 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c17bc302-7f96-4ef1-803f-38908081e9ad tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:37.418704 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c17bc302-7f96-4ef1-803f-38908081e9ad tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:37.419454 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c17bc302-7f96-4ef1-803f-38908081e9ad tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:37.419888 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c17bc302-7f96-4ef1-803f-38908081e9ad tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:37.564981 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c17bc302-7f96-4ef1-803f-38908081e9ad tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:37.572694 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c17bc302-7f96-4ef1-803f-38908081e9ad tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1359 microversion: 2.1 time: 0.165090 Jun 22 09:35:37.573306 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 944/1840] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:37 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:35:38.590998 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-20a21544-52a0-435a-a0d3-6e91dd1e947e tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:38.591660 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-20a21544-52a0-435a-a0d3-6e91dd1e947e tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:38.599329 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-20a21544-52a0-435a-a0d3-6e91dd1e947e tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:38.599769 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-20a21544-52a0-435a-a0d3-6e91dd1e947e tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:38.600547 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-20a21544-52a0-435a-a0d3-6e91dd1e947e tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:38.601006 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-20a21544-52a0-435a-a0d3-6e91dd1e947e tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:38.735437 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-20a21544-52a0-435a-a0d3-6e91dd1e947e tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:38.743983 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-20a21544-52a0-435a-a0d3-6e91dd1e947e tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1359 microversion: 2.1 time: 0.157658 Jun 22 09:35:38.744686 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 897/1841] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:38 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:35:39.762137 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-65dbe1ed-9457-48f6-9f0b-65194dd2dc9a tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:39.762914 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-65dbe1ed-9457-48f6-9f0b-65194dd2dc9a tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:39.765782 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:35:39.770788 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-65dbe1ed-9457-48f6-9f0b-65194dd2dc9a tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:39.771245 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-65dbe1ed-9457-48f6-9f0b-65194dd2dc9a tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:39.772012 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-65dbe1ed-9457-48f6-9f0b-65194dd2dc9a tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:39.772453 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-65dbe1ed-9457-48f6-9f0b-65194dd2dc9a tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:39.776588 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=69 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:35:39.912524 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-65dbe1ed-9457-48f6-9f0b-65194dd2dc9a tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:39.920214 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-65dbe1ed-9457-48f6-9f0b-65194dd2dc9a tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1359 microversion: 2.1 time: 0.161979 Jun 22 09:35:39.920798 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 945/1842] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:39 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:35:40.937190 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-bdbb0cb5-b4aa-4cf9-8ef7-d3a3dd0e453b tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:40.938026 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-bdbb0cb5-b4aa-4cf9-8ef7-d3a3dd0e453b tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:40.940413 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:35:40.945355 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bdbb0cb5-b4aa-4cf9-8ef7-d3a3dd0e453b tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:40.945813 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bdbb0cb5-b4aa-4cf9-8ef7-d3a3dd0e453b tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:40.946602 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bdbb0cb5-b4aa-4cf9-8ef7-d3a3dd0e453b tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:40.947048 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bdbb0cb5-b4aa-4cf9-8ef7-d3a3dd0e453b tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:41.083320 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-bdbb0cb5-b4aa-4cf9-8ef7-d3a3dd0e453b tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:41.091074 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-bdbb0cb5-b4aa-4cf9-8ef7-d3a3dd0e453b tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1359 microversion: 2.1 time: 0.157876 Jun 22 09:35:41.091654 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 898/1843] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:40 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:35:42.109345 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-6cfb5406-e852-4efa-9f23-daff0d5edc97 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:42.110387 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-6cfb5406-e852-4efa-9f23-daff0d5edc97 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:42.117330 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6cfb5406-e852-4efa-9f23-daff0d5edc97 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:42.117854 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6cfb5406-e852-4efa-9f23-daff0d5edc97 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:42.118641 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6cfb5406-e852-4efa-9f23-daff0d5edc97 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:42.122290 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6cfb5406-e852-4efa-9f23-daff0d5edc97 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:42.278231 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-6cfb5406-e852-4efa-9f23-daff0d5edc97 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:42.287045 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-6cfb5406-e852-4efa-9f23-daff0d5edc97 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1359 microversion: 2.1 time: 0.181786 Jun 22 09:35:42.287635 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 946/1844] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:42 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:35:42.821761 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [req-df01edef-22ee-491f-93b4-3151711c052f req-503f27e6-1120-4412-a1a2-ba05faf203ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e8c5a28-f8ae-45eb-bbf9-b28ae208c285", "tag": "bdb6db07-5143-42e2-bb43-ef3b56c62ba1"}]} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:35:42.834788 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-df01edef-22ee-491f-93b4-3151711c052f req-503f27e6-1120-4412-a1a2-ba05faf203ca service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:42.835238 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-df01edef-22ee-491f-93b4-3151711c052f req-503f27e6-1120-4412-a1a2-ba05faf203ca service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:42.852854 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.compute.server_external_events [req-df01edef-22ee-491f-93b4-3151711c052f req-503f27e6-1120-4412-a1a2-ba05faf203ca service nova] Creating event network-changed:bdb6db07-5143-42e2-bb43-ef3b56c62ba1 for instance 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 on hv-cinder-84599 Jun 22 09:35:42.858538 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [req-df01edef-22ee-491f-93b4-3151711c052f req-503f27e6-1120-4412-a1a2-ba05faf203ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.230198 Jun 22 09:35:42.860512 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 899/1845] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:35:43.304920 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-fcff87a5-4ce3-48f1-9966-e516d4410088 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:43.305573 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-fcff87a5-4ce3-48f1-9966-e516d4410088 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:43.323997 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fcff87a5-4ce3-48f1-9966-e516d4410088 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:43.323997 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fcff87a5-4ce3-48f1-9966-e516d4410088 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:43.323997 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fcff87a5-4ce3-48f1-9966-e516d4410088 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:43.323997 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-fcff87a5-4ce3-48f1-9966-e516d4410088 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:43.457983 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-fcff87a5-4ce3-48f1-9966-e516d4410088 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:43.466288 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-fcff87a5-4ce3-48f1-9966-e516d4410088 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1359 microversion: 2.1 time: 0.165472 Jun 22 09:35:43.466850 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 947/1846] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:43 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:35:44.484438 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a1ab27df-17aa-4b62-b88e-86df5c3a0c79 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:44.485190 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a1ab27df-17aa-4b62-b88e-86df5c3a0c79 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:44.492183 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a1ab27df-17aa-4b62-b88e-86df5c3a0c79 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:44.492628 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a1ab27df-17aa-4b62-b88e-86df5c3a0c79 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:44.493749 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a1ab27df-17aa-4b62-b88e-86df5c3a0c79 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:44.494424 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a1ab27df-17aa-4b62-b88e-86df5c3a0c79 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:44.632247 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-a1ab27df-17aa-4b62-b88e-86df5c3a0c79 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:44.640194 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a1ab27df-17aa-4b62-b88e-86df5c3a0c79 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1359 microversion: 2.1 time: 0.159916 Jun 22 09:35:44.640764 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 900/1847] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:44 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:35:45.659830 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d5697702-3e72-44a6-a53d-ddafdb8a75e1 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:45.660455 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-d5697702-3e72-44a6-a53d-ddafdb8a75e1 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:45.672771 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d5697702-3e72-44a6-a53d-ddafdb8a75e1 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:45.673390 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d5697702-3e72-44a6-a53d-ddafdb8a75e1 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:45.674176 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d5697702-3e72-44a6-a53d-ddafdb8a75e1 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:45.674620 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d5697702-3e72-44a6-a53d-ddafdb8a75e1 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:45.819489 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-d5697702-3e72-44a6-a53d-ddafdb8a75e1 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:45.827780 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d5697702-3e72-44a6-a53d-ddafdb8a75e1 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1359 microversion: 2.1 time: 0.172458 Jun 22 09:35:45.828374 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 948/1848] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:45 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:35:46.851219 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-4693171b-1d4e-4cd6-a5f6-8c79c3fa8bae tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:46.855042 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-4693171b-1d4e-4cd6-a5f6-8c79c3fa8bae tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:46.866066 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4693171b-1d4e-4cd6-a5f6-8c79c3fa8bae tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:46.866614 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4693171b-1d4e-4cd6-a5f6-8c79c3fa8bae tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:46.867813 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4693171b-1d4e-4cd6-a5f6-8c79c3fa8bae tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:46.868817 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4693171b-1d4e-4cd6-a5f6-8c79c3fa8bae tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:46.875622 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=87 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:35:47.029904 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-4693171b-1d4e-4cd6-a5f6-8c79c3fa8bae tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:47.043753 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-4693171b-1d4e-4cd6-a5f6-8c79c3fa8bae tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1359 microversion: 2.1 time: 0.200659 Jun 22 09:35:47.044357 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 901/1849] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:46 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1359 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:35:48.061500 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-3fd18907-bdef-40b7-9ae1-b31de1654c7a tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:48.062112 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-3fd18907-bdef-40b7-9ae1-b31de1654c7a tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:48.069082 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3fd18907-bdef-40b7-9ae1-b31de1654c7a tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:48.069525 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3fd18907-bdef-40b7-9ae1-b31de1654c7a tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:48.070288 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3fd18907-bdef-40b7-9ae1-b31de1654c7a tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:48.070722 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3fd18907-bdef-40b7-9ae1-b31de1654c7a tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:48.211454 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-3fd18907-bdef-40b7-9ae1-b31de1654c7a tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:48.220896 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-3fd18907-bdef-40b7-9ae1-b31de1654c7a tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1359 microversion: 2.1 time: 0.162884 Jun 22 09:35:48.221674 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 949/1850] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:48 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:35:49.246787 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3ec4ba3e-864f-43f8-b011-bca5e38a6e8c tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:49.246787 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3ec4ba3e-864f-43f8-b011-bca5e38a6e8c tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:49.253026 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3ec4ba3e-864f-43f8-b011-bca5e38a6e8c tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:49.253885 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3ec4ba3e-864f-43f8-b011-bca5e38a6e8c tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:49.255550 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3ec4ba3e-864f-43f8-b011-bca5e38a6e8c tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:49.256355 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3ec4ba3e-864f-43f8-b011-bca5e38a6e8c tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:49.476096 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3ec4ba3e-864f-43f8-b011-bca5e38a6e8c tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:49.485450 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3ec4ba3e-864f-43f8-b011-bca5e38a6e8c tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1359 microversion: 2.1 time: 0.250614 Jun 22 09:35:49.496340 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 902/1851] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:49 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1359 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:35:49.501111 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-fd8b30b6-1553-4fc1-bca3-40cb0b28036c req-bb16238b-c040-4f54-a656-db1f29997fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e8c5a28-f8ae-45eb-bbf9-b28ae208c285", "name": "network-vif-plugged", "status": "completed", "tag": "bdb6db07-5143-42e2-bb43-ef3b56c62ba1"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:35:49.518399 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-fd8b30b6-1553-4fc1-bca3-40cb0b28036c req-bb16238b-c040-4f54-a656-db1f29997fe7 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:49.518844 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-fd8b30b6-1553-4fc1-bca3-40cb0b28036c req-bb16238b-c040-4f54-a656-db1f29997fe7 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:49.533828 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-fd8b30b6-1553-4fc1-bca3-40cb0b28036c req-bb16238b-c040-4f54-a656-db1f29997fe7 service nova] Creating event network-vif-plugged:bdb6db07-5143-42e2-bb43-ef3b56c62ba1 for instance 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 on hv-cinder-84599 Jun 22 09:35:49.539268 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-fd8b30b6-1553-4fc1-bca3-40cb0b28036c req-bb16238b-c040-4f54-a656-db1f29997fe7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141237 Jun 22 09:35:49.539878 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 950/1852] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:35:50.504383 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-2098459c-510d-4501-9d1c-6f092069577e tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:50.504962 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-2098459c-510d-4501-9d1c-6f092069577e tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:50.511721 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2098459c-510d-4501-9d1c-6f092069577e tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:50.512167 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2098459c-510d-4501-9d1c-6f092069577e tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:50.512970 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2098459c-510d-4501-9d1c-6f092069577e tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:50.513413 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2098459c-510d-4501-9d1c-6f092069577e tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:50.652934 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-2098459c-510d-4501-9d1c-6f092069577e tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:50.660809 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-2098459c-510d-4501-9d1c-6f092069577e tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1359 microversion: 2.1 time: 0.161984 Jun 22 09:35:50.661620 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 903/1853] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:50 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:35:51.685802 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-1c51f7e7-baf8-48b6-8eca-aebe73c3afe8 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:51.686495 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-1c51f7e7-baf8-48b6-8eca-aebe73c3afe8 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:51.693743 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1c51f7e7-baf8-48b6-8eca-aebe73c3afe8 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:51.694188 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1c51f7e7-baf8-48b6-8eca-aebe73c3afe8 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:51.694958 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1c51f7e7-baf8-48b6-8eca-aebe73c3afe8 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:51.695389 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1c51f7e7-baf8-48b6-8eca-aebe73c3afe8 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:51.856896 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-1c51f7e7-baf8-48b6-8eca-aebe73c3afe8 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:51.862735 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-1c51f7e7-baf8-48b6-8eca-aebe73c3afe8 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1359 microversion: 2.1 time: 0.187885 Jun 22 09:35:51.862735 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 951/1854] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:51 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:35:52.889332 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3a7e7af9-b330-49b0-b374-746f4d2228e7 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:52.889332 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3a7e7af9-b330-49b0-b374-746f4d2228e7 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:52.893019 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3a7e7af9-b330-49b0-b374-746f4d2228e7 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:52.893487 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3a7e7af9-b330-49b0-b374-746f4d2228e7 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:52.894377 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3a7e7af9-b330-49b0-b374-746f4d2228e7 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:52.894835 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3a7e7af9-b330-49b0-b374-746f4d2228e7 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:53.029690 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3a7e7af9-b330-49b0-b374-746f4d2228e7 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:53.037510 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3a7e7af9-b330-49b0-b374-746f4d2228e7 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1550 microversion: 2.1 time: 0.156640 Jun 22 09:35:53.047520 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 904/1855] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:52 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1550 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:35:53.058044 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-45a32d26-9954-40a2-a4f2-67a778ed76f0 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:53.059102 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-45a32d26-9954-40a2-a4f2-67a778ed76f0 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:53.068908 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-45a32d26-9954-40a2-a4f2-67a778ed76f0 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:53.069519 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-45a32d26-9954-40a2-a4f2-67a778ed76f0 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:53.070392 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-45a32d26-9954-40a2-a4f2-67a778ed76f0 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:53.070930 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-45a32d26-9954-40a2-a4f2-67a778ed76f0 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:53.206325 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-45a32d26-9954-40a2-a4f2-67a778ed76f0 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:53.216075 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-45a32d26-9954-40a2-a4f2-67a778ed76f0 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1550 microversion: 2.1 time: 0.164938 Jun 22 09:35:53.216655 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 952/1856] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:53 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1550 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:35:53.232196 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-06b16a4b-6235-440d-ad68-4327de20ccec tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:53.235637 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-06b16a4b-6235-440d-ad68-4327de20ccec tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:53.237207 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-06b16a4b-6235-440d-ad68-4327de20ccec tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Searching by: {'deleted': False, 'project_id': '8c5252320d824d608d9ac574bf61dcc5'} {{(pid=118024) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 22 09:35:53.243902 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-06b16a4b-6235-440d-ad68-4327de20ccec tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:53.244350 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-06b16a4b-6235-440d-ad68-4327de20ccec tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:53.245177 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-06b16a4b-6235-440d-ad68-4327de20ccec tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:53.245615 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-06b16a4b-6235-440d-ad68-4327de20ccec tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:53.339022 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.multi_cell_list [None req-06b16a4b-6235-440d-ad68-4327de20ccec tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118024) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 22 09:35:53.445049 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-06b16a4b-6235-440d-ad68-4327de20ccec tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.212778 Jun 22 09:35:53.445049 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 905/1857] 10.222.0.16 () {58 vars in 1124 bytes} [Wed Jun 22 09:35:53 2022] GET /compute/v2.1/servers => generated 343 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:35:53.452129 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-039644f1-2b6f-4624-899c-d629ebac9443 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:35:53.452970 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-039644f1-2b6f-4624-899c-d629ebac9443 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:53.460197 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-039644f1-2b6f-4624-899c-d629ebac9443 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:53.460925 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-039644f1-2b6f-4624-899c-d629ebac9443 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:53.461708 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-039644f1-2b6f-4624-899c-d629ebac9443 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:53.462152 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-039644f1-2b6f-4624-899c-d629ebac9443 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:53.601177 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-039644f1-2b6f-4624-899c-d629ebac9443 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:35:53.607023 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-039644f1-2b6f-4624-899c-d629ebac9443 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1550 microversion: 2.1 time: 0.159035 Jun 22 09:35:53.607598 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 953/1858] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:35:53 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1550 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:35:56.615049 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-425ffaa5-3888-4666-869f-1ad3e86e8653 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47f834bf-e2c4-4957-b55a-5197249ca8e3"}} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:35:56.616170 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-425ffaa5-3888-4666-869f-1ad3e86e8653 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:35:56.623233 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-425ffaa5-3888-4666-869f-1ad3e86e8653 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:56.623696 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-425ffaa5-3888-4666-869f-1ad3e86e8653 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:56.624473 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-425ffaa5-3888-4666-869f-1ad3e86e8653 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:35:56.624952 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-425ffaa5-3888-4666-869f-1ad3e86e8653 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:35:57.568405 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-425ffaa5-3888-4666-869f-1ad3e86e8653 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "POST /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.957807 Jun 22 09:35:57.569116 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 906/1859] 10.222.0.16 () {60 vars in 1322 bytes} [Wed Jun 22 09:35:56 2022] POST /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285/os-volume_attachments => generated 194 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:36:04.771087 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-76cfc8c4-10b6-47e3-8e23-e5ac3bb2b339 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1123202874", "imageRef": "c24d36a8-7909-4174-9b12-42c8d76647ac", "flavorRef": "452"}} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:36:04.777756 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=17 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:36:04.778445 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=49 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:36:04.828478 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.network.neutron [None req-76cfc8c4-10b6-47e3-8e23-e5ac3bb2b339 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] validate_networks() for None {{(pid=118025) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:36:05.181232 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-76cfc8c4-10b6-47e3-8e23-e5ac3bb2b339 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Flavor limits 0:0:0 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:36:05.181662 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-76cfc8c4-10b6-47e3-8e23-e5ac3bb2b339 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Image limits 0:0:0 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:36:05.182167 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-76cfc8c4-10b6-47e3-8e23-e5ac3bb2b339 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Flavor pref 0:0:0 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:36:05.182569 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-76cfc8c4-10b6-47e3-8e23-e5ac3bb2b339 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Image pref 0:0:0 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:36:05.183188 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-76cfc8c4-10b6-47e3-8e23-e5ac3bb2b339 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:36:05.197491 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-76cfc8c4-10b6-47e3-8e23-e5ac3bb2b339 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:05.198255 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-76cfc8c4-10b6-47e3-8e23-e5ac3bb2b339 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:05.199182 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-76cfc8c4-10b6-47e3-8e23-e5ac3bb2b339 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:05.199713 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-76cfc8c4-10b6-47e3-8e23-e5ac3bb2b339 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:05.225453 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.quota [None req-76cfc8c4-10b6-47e3-8e23-e5ac3bb2b339 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Getting quotas for project cf8ee5a981ad41518a0f9006ae90a80b. Resources: {'cores', 'instances', 'ram'} {{(pid=118025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:36:05.231050 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.quota [None req-76cfc8c4-10b6-47e3-8e23-e5ac3bb2b339 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Getting quotas for user c65367e79fcc4034933e6f76ec04564d and project cf8ee5a981ad41518a0f9006ae90a80b. Resources: {'cores', 'instances', 'ram'} {{(pid=118025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:36:05.246838 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-76cfc8c4-10b6-47e3-8e23-e5ac3bb2b339 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Going to run 1 instances... {{(pid=118025) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:36:05.249303 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-76cfc8c4-10b6-47e3-8e23-e5ac3bb2b339 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] [instance: c81ffceb-428d-4067-a52c-22cda52ad95c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c24d36a8-7909-4174-9b12-42c8d76647ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:36:05.362189 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-76cfc8c4-10b6-47e3-8e23-e5ac3bb2b339 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595445 Jun 22 09:36:05.363541 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 954/1860] 10.222.0.16 () {60 vars in 1146 bytes} [Wed Jun 22 09:36:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:36:05.373569 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell0:SELECT=2 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:36:05.378946 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3582e47b-4e22-4f89-91f4-1ab0aa0cc96c tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:36:05.379688 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3582e47b-4e22-4f89-91f4-1ab0aa0cc96c tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] [instance: c81ffceb-428d-4067-a52c-22cda52ad95c] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:36:05.443646 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3582e47b-4e22-4f89-91f4-1ab0aa0cc96c tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65367e79fcc4034933e6f76ec04564d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ee5a981ad41518a0f9006ae90a80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:36:05.456903 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3582e47b-4e22-4f89-91f4-1ab0aa0cc96c tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] 10.222.0.16 "GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c" status: 200 len: 1215 microversion: 2.1 time: 0.085934 Jun 22 09:36:05.457792 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 907/1861] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:36:05 2022] GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c => generated 1215 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:36:06.252908 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-8a0c8b19-d0f5-47d6-b9b6-4cf0c5700409 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:36:06.252908 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-8a0c8b19-d0f5-47d6-b9b6-4cf0c5700409 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:36:06.257637 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8a0c8b19-d0f5-47d6-b9b6-4cf0c5700409 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:06.257895 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8a0c8b19-d0f5-47d6-b9b6-4cf0c5700409 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:06.258676 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8a0c8b19-d0f5-47d6-b9b6-4cf0c5700409 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:06.259312 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8a0c8b19-d0f5-47d6-b9b6-4cf0c5700409 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:06.405921 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-8a0c8b19-d0f5-47d6-b9b6-4cf0c5700409 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:36:06.414266 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-8a0c8b19-d0f5-47d6-b9b6-4cf0c5700409 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1596 microversion: 2.1 time: 0.169756 Jun 22 09:36:06.414860 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 955/1862] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:36:06 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1596 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:36:06.477245 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-5c7f24ae-90f4-461e-82d7-97488c53352c tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:36:06.481299 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-5c7f24ae-90f4-461e-82d7-97488c53352c tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] [instance: c81ffceb-428d-4067-a52c-22cda52ad95c] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:36:06.546080 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-5c7f24ae-90f4-461e-82d7-97488c53352c tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65367e79fcc4034933e6f76ec04564d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ee5a981ad41518a0f9006ae90a80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:36:06.553534 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-5c7f24ae-90f4-461e-82d7-97488c53352c tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] 10.222.0.16 "GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c" status: 200 len: 1215 microversion: 2.1 time: 0.080876 Jun 22 09:36:06.554668 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 908/1863] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:36:06 2022] GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c => generated 1215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:36:07.571199 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-03eb3bec-37c7-4743-97b5-9bc9358f2c82 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:36:07.571797 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-03eb3bec-37c7-4743-97b5-9bc9358f2c82 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] [instance: c81ffceb-428d-4067-a52c-22cda52ad95c] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:36:07.577924 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-03eb3bec-37c7-4743-97b5-9bc9358f2c82 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:07.578381 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-03eb3bec-37c7-4743-97b5-9bc9358f2c82 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:07.579205 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-03eb3bec-37c7-4743-97b5-9bc9358f2c82 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:07.579651 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-03eb3bec-37c7-4743-97b5-9bc9358f2c82 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:07.663388 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-03eb3bec-37c7-4743-97b5-9bc9358f2c82 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65367e79fcc4034933e6f76ec04564d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ee5a981ad41518a0f9006ae90a80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:36:07.672743 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-03eb3bec-37c7-4743-97b5-9bc9358f2c82 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] 10.222.0.16 "GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c" status: 200 len: 1267 microversion: 2.1 time: 0.105568 Jun 22 09:36:07.675830 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 956/1864] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:36:07 2022] GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c => generated 1267 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:36:08.689228 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3d5a2cc1-fd0c-4225-b1cb-a1cb24e2220b tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:36:08.691571 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3d5a2cc1-fd0c-4225-b1cb-a1cb24e2220b tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] [instance: c81ffceb-428d-4067-a52c-22cda52ad95c] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:36:08.699250 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:36:08.701564 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3d5a2cc1-fd0c-4225-b1cb-a1cb24e2220b tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:08.702254 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3d5a2cc1-fd0c-4225-b1cb-a1cb24e2220b tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:08.703244 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3d5a2cc1-fd0c-4225-b1cb-a1cb24e2220b tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:08.703909 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3d5a2cc1-fd0c-4225-b1cb-a1cb24e2220b tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:08.776356 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3d5a2cc1-fd0c-4225-b1cb-a1cb24e2220b tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65367e79fcc4034933e6f76ec04564d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ee5a981ad41518a0f9006ae90a80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:36:08.784046 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3d5a2cc1-fd0c-4225-b1cb-a1cb24e2220b tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] 10.222.0.16 "GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c" status: 200 len: 1273 microversion: 2.1 time: 0.098687 Jun 22 09:36:08.784613 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 909/1865] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:36:08 2022] GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c => generated 1273 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:36:09.152927 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-24a65a1e-65d8-46d0-83a0-4acc9919c228 req-e3b773fd-98ec-471a-8b22-ccec34db1264 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e8c5a28-f8ae-45eb-bbf9-b28ae208c285", "tag": "bdb6db07-5143-42e2-bb43-ef3b56c62ba1"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:36:09.161455 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-24a65a1e-65d8-46d0-83a0-4acc9919c228 req-e3b773fd-98ec-471a-8b22-ccec34db1264 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:09.162195 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-24a65a1e-65d8-46d0-83a0-4acc9919c228 req-e3b773fd-98ec-471a-8b22-ccec34db1264 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:09.177500 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-24a65a1e-65d8-46d0-83a0-4acc9919c228 req-e3b773fd-98ec-471a-8b22-ccec34db1264 service nova] Creating event network-changed:bdb6db07-5143-42e2-bb43-ef3b56c62ba1 for instance 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 on hv-cinder-84599 Jun 22 09:36:09.183020 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-24a65a1e-65d8-46d0-83a0-4acc9919c228 req-e3b773fd-98ec-471a-8b22-ccec34db1264 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164068 Jun 22 09:36:09.183694 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 957/1866] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:36:09.801986 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-09c498e6-9c06-4dfc-a2f7-ce3cd6b17072 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:36:09.802638 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-09c498e6-9c06-4dfc-a2f7-ce3cd6b17072 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] [instance: c81ffceb-428d-4067-a52c-22cda52ad95c] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:36:09.810786 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-09c498e6-9c06-4dfc-a2f7-ce3cd6b17072 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:09.811841 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-09c498e6-9c06-4dfc-a2f7-ce3cd6b17072 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:09.812866 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-09c498e6-9c06-4dfc-a2f7-ce3cd6b17072 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:09.813449 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-09c498e6-9c06-4dfc-a2f7-ce3cd6b17072 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:10.018496 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-09c498e6-9c06-4dfc-a2f7-ce3cd6b17072 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65367e79fcc4034933e6f76ec04564d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ee5a981ad41518a0f9006ae90a80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:36:10.028846 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-09c498e6-9c06-4dfc-a2f7-ce3cd6b17072 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] 10.222.0.16 "GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c" status: 200 len: 1315 microversion: 2.1 time: 0.231077 Jun 22 09:36:10.029764 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 910/1867] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:36:09 2022] GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:36:10.411515 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-31ad5193-bd4b-42b2-b586-eb651ce3aba8 req-c093653c-8fbd-4bf3-bffa-2030141ce55b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c81ffceb-428d-4067-a52c-22cda52ad95c", "tag": "b4911097-b5f9-4156-a09d-df970709fafe"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:36:10.436385 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-31ad5193-bd4b-42b2-b586-eb651ce3aba8 req-c093653c-8fbd-4bf3-bffa-2030141ce55b service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:10.437942 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-31ad5193-bd4b-42b2-b586-eb651ce3aba8 req-c093653c-8fbd-4bf3-bffa-2030141ce55b service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:10.467293 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-31ad5193-bd4b-42b2-b586-eb651ce3aba8 req-c093653c-8fbd-4bf3-bffa-2030141ce55b service nova] Creating event network-changed:b4911097-b5f9-4156-a09d-df970709fafe for instance c81ffceb-428d-4067-a52c-22cda52ad95c on hv-cinder-84599 Jun 22 09:36:10.467293 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-31ad5193-bd4b-42b2-b586-eb651ce3aba8 req-c093653c-8fbd-4bf3-bffa-2030141ce55b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078156 Jun 22 09:36:10.467293 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 958/1868] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:36:11.047224 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-d1060573-9a2c-4fdf-a577-110208859861 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:36:11.047838 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-d1060573-9a2c-4fdf-a577-110208859861 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] [instance: c81ffceb-428d-4067-a52c-22cda52ad95c] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:36:11.054494 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d1060573-9a2c-4fdf-a577-110208859861 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:11.055544 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d1060573-9a2c-4fdf-a577-110208859861 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:11.056916 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d1060573-9a2c-4fdf-a577-110208859861 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:11.057439 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-d1060573-9a2c-4fdf-a577-110208859861 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:11.218010 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-d1060573-9a2c-4fdf-a577-110208859861 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65367e79fcc4034933e6f76ec04564d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ee5a981ad41518a0f9006ae90a80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:36:11.226613 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-d1060573-9a2c-4fdf-a577-110208859861 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] 10.222.0.16 "GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c" status: 200 len: 1315 microversion: 2.1 time: 0.183938 Jun 22 09:36:11.228154 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 911/1869] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:36:11 2022] GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:36:12.246787 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c984694e-224b-4f69-a572-4f5c0a2aa1a7 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:36:12.247532 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c984694e-224b-4f69-a572-4f5c0a2aa1a7 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] [instance: c81ffceb-428d-4067-a52c-22cda52ad95c] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:36:12.254261 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c984694e-224b-4f69-a572-4f5c0a2aa1a7 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:12.254734 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c984694e-224b-4f69-a572-4f5c0a2aa1a7 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:12.255491 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c984694e-224b-4f69-a572-4f5c0a2aa1a7 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:12.255934 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c984694e-224b-4f69-a572-4f5c0a2aa1a7 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:12.295365 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-5e34cb27-5a89-466a-b73b-44c488e7531d tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1674044749"}} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:36:12.296001 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-5e34cb27-5a89-466a-b73b-44c488e7531d tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:36:12.302865 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5e34cb27-5a89-466a-b73b-44c488e7531d tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:12.303364 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5e34cb27-5a89-466a-b73b-44c488e7531d tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:12.304145 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5e34cb27-5a89-466a-b73b-44c488e7531d tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:12.304580 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5e34cb27-5a89-466a-b73b-44c488e7531d tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:12.426638 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c984694e-224b-4f69-a572-4f5c0a2aa1a7 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65367e79fcc4034933e6f76ec04564d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ee5a981ad41518a0f9006ae90a80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:36:12.434539 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c984694e-224b-4f69-a572-4f5c0a2aa1a7 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] 10.222.0.16 "GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c" status: 200 len: 1315 microversion: 2.1 time: 0.193716 Jun 22 09:36:12.435119 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 959/1870] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:36:12 2022] GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:36:12.475672 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.network.security_group_api [None req-5e34cb27-5a89-466a-b73b-44c488e7531d tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Adding security group 40ab409d-dfb4-438c-88ac-6103afa07e35 to port bdb6db07-5143-42e2-bb43-ef3b56c62ba1 Jun 22 09:36:12.986098 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-5e34cb27-5a89-466a-b73b-44c488e7531d tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "POST /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285/action" status: 202 len: 0 microversion: 2.1 time: 0.694662 Jun 22 09:36:12.991616 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 912/1871] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jun 22 09:36:12 2022] POST /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285/action => generated 0 bytes in 701 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 09:36:12.997472 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-78ff0819-43c3-46a0-b1fd-5d17e404a21c tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:36:12.998026 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-a15570fc-e5e0-4689-b59d-1fc42cd8b3f0 req-6c3390bc-4a16-49d1-a78d-25e9070231bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e8c5a28-f8ae-45eb-bbf9-b28ae208c285", "tag": "bdb6db07-5143-42e2-bb43-ef3b56c62ba1"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:36:13.001601 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-78ff0819-43c3-46a0-b1fd-5d17e404a21c tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:36:13.004577 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=34 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:36:13.006356 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-78ff0819-43c3-46a0-b1fd-5d17e404a21c tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:13.006994 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-78ff0819-43c3-46a0-b1fd-5d17e404a21c tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:13.008018 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-78ff0819-43c3-46a0-b1fd-5d17e404a21c tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:13.009332 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-78ff0819-43c3-46a0-b1fd-5d17e404a21c tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:13.025940 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-a15570fc-e5e0-4689-b59d-1fc42cd8b3f0 req-6c3390bc-4a16-49d1-a78d-25e9070231bf service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:13.026399 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-a15570fc-e5e0-4689-b59d-1fc42cd8b3f0 req-6c3390bc-4a16-49d1-a78d-25e9070231bf service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:13.041348 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-a15570fc-e5e0-4689-b59d-1fc42cd8b3f0 req-6c3390bc-4a16-49d1-a78d-25e9070231bf service nova] Creating event network-changed:bdb6db07-5143-42e2-bb43-ef3b56c62ba1 for instance 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 on hv-cinder-84599 Jun 22 09:36:13.046568 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-a15570fc-e5e0-4689-b59d-1fc42cd8b3f0 req-6c3390bc-4a16-49d1-a78d-25e9070231bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055196 Jun 22 09:36:13.047166 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 960/1872] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:36:13.186181 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-78ff0819-43c3-46a0-b1fd-5d17e404a21c tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:36:13.200722 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-78ff0819-43c3-46a0-b1fd-5d17e404a21c tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1761 microversion: 2.1 time: 0.207498 Jun 22 09:36:13.202010 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 913/1873] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:36:12 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1761 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:36:13.453068 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-6ae83b15-6c6d-414b-b559-0198fa0e49c2 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:36:13.453731 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-6ae83b15-6c6d-414b-b559-0198fa0e49c2 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] [instance: c81ffceb-428d-4067-a52c-22cda52ad95c] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:36:13.460136 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6ae83b15-6c6d-414b-b559-0198fa0e49c2 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:13.461109 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6ae83b15-6c6d-414b-b559-0198fa0e49c2 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:13.462409 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6ae83b15-6c6d-414b-b559-0198fa0e49c2 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:13.462976 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6ae83b15-6c6d-414b-b559-0198fa0e49c2 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:13.597983 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-6ae83b15-6c6d-414b-b559-0198fa0e49c2 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65367e79fcc4034933e6f76ec04564d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ee5a981ad41518a0f9006ae90a80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:36:13.617676 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-6ae83b15-6c6d-414b-b559-0198fa0e49c2 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] 10.222.0.16 "GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c" status: 200 len: 1315 microversion: 2.1 time: 0.159275 Jun 22 09:36:13.617676 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 961/1874] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:36:13 2022] GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:36:14.625299 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-00582d59-9610-4da5-9f75-bc8b6c2935bf tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:36:14.625913 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-00582d59-9610-4da5-9f75-bc8b6c2935bf tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] [instance: c81ffceb-428d-4067-a52c-22cda52ad95c] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:36:14.632351 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-00582d59-9610-4da5-9f75-bc8b6c2935bf tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:14.632830 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-00582d59-9610-4da5-9f75-bc8b6c2935bf tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:14.633595 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-00582d59-9610-4da5-9f75-bc8b6c2935bf tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:14.634192 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-00582d59-9610-4da5-9f75-bc8b6c2935bf tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:14.785645 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-00582d59-9610-4da5-9f75-bc8b6c2935bf tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65367e79fcc4034933e6f76ec04564d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ee5a981ad41518a0f9006ae90a80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:36:14.793954 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-00582d59-9610-4da5-9f75-bc8b6c2935bf tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] 10.222.0.16 "GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c" status: 200 len: 1315 microversion: 2.1 time: 0.172580 Jun 22 09:36:14.794553 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 914/1875] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:36:14 2022] GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:36:15.742372 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-af317746-f9c8-405f-bf72-0a6641e6d487 req-3758a6ee-d7a3-49ef-a9d0-6cac675af976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c81ffceb-428d-4067-a52c-22cda52ad95c", "name": "network-vif-plugged", "status": "completed", "tag": "b4911097-b5f9-4156-a09d-df970709fafe"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:36:15.748766 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell0:SELECT=2 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:36:15.749742 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell0:SELECT=6 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:36:15.754982 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-af317746-f9c8-405f-bf72-0a6641e6d487 req-3758a6ee-d7a3-49ef-a9d0-6cac675af976 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:15.760083 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-af317746-f9c8-405f-bf72-0a6641e6d487 req-3758a6ee-d7a3-49ef-a9d0-6cac675af976 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:15.768382 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-af317746-f9c8-405f-bf72-0a6641e6d487 req-3758a6ee-d7a3-49ef-a9d0-6cac675af976 service nova] Creating event network-vif-plugged:b4911097-b5f9-4156-a09d-df970709fafe for instance c81ffceb-428d-4067-a52c-22cda52ad95c on hv-cinder-84599 Jun 22 09:36:15.773513 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-af317746-f9c8-405f-bf72-0a6641e6d487 req-3758a6ee-d7a3-49ef-a9d0-6cac675af976 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035179 Jun 22 09:36:15.775071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 962/1876] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:36:15.812797 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-27f36ff5-63a8-4cd6-b4a9-de817cd0f441 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:36:15.813703 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-27f36ff5-63a8-4cd6-b4a9-de817cd0f441 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] [instance: c81ffceb-428d-4067-a52c-22cda52ad95c] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:36:15.820258 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-27f36ff5-63a8-4cd6-b4a9-de817cd0f441 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:15.820723 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-27f36ff5-63a8-4cd6-b4a9-de817cd0f441 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:15.821608 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-27f36ff5-63a8-4cd6-b4a9-de817cd0f441 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:15.822045 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-27f36ff5-63a8-4cd6-b4a9-de817cd0f441 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:15.966215 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-27f36ff5-63a8-4cd6-b4a9-de817cd0f441 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65367e79fcc4034933e6f76ec04564d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ee5a981ad41518a0f9006ae90a80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:36:15.975024 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-27f36ff5-63a8-4cd6-b4a9-de817cd0f441 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] 10.222.0.16 "GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c" status: 200 len: 1315 microversion: 2.1 time: 0.167380 Jun 22 09:36:15.975606 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 915/1877] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:36:15 2022] GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:36:16.994660 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-9d545db8-43f9-45bc-bbec-282339380e12 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:36:16.995287 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-9d545db8-43f9-45bc-bbec-282339380e12 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] [instance: c81ffceb-428d-4067-a52c-22cda52ad95c] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:36:17.002713 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9d545db8-43f9-45bc-bbec-282339380e12 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:17.003162 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9d545db8-43f9-45bc-bbec-282339380e12 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:17.004094 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9d545db8-43f9-45bc-bbec-282339380e12 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:17.004629 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-9d545db8-43f9-45bc-bbec-282339380e12 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:17.140481 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-9d545db8-43f9-45bc-bbec-282339380e12 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65367e79fcc4034933e6f76ec04564d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ee5a981ad41518a0f9006ae90a80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:36:17.148597 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-9d545db8-43f9-45bc-bbec-282339380e12 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] 10.222.0.16 "GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c" status: 200 len: 1315 microversion: 2.1 time: 0.158979 Jun 22 09:36:17.149272 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 963/1878] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:36:16 2022] GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:36:18.166860 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-28bff81e-7f4d-4707-94ae-3b53ecbed16e tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:36:18.167497 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-28bff81e-7f4d-4707-94ae-3b53ecbed16e tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] [instance: c81ffceb-428d-4067-a52c-22cda52ad95c] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:36:18.173675 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell0:SELECT=4 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:36:18.174774 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-28bff81e-7f4d-4707-94ae-3b53ecbed16e tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:18.175228 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-28bff81e-7f4d-4707-94ae-3b53ecbed16e tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:18.176088 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-28bff81e-7f4d-4707-94ae-3b53ecbed16e tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:18.176628 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-28bff81e-7f4d-4707-94ae-3b53ecbed16e tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:18.311535 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-28bff81e-7f4d-4707-94ae-3b53ecbed16e tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65367e79fcc4034933e6f76ec04564d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ee5a981ad41518a0f9006ae90a80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:36:18.318986 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-28bff81e-7f4d-4707-94ae-3b53ecbed16e tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] 10.222.0.16 "GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c" status: 200 len: 1465 microversion: 2.1 time: 0.156741 Jun 22 09:36:18.319550 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 916/1879] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:36:18 2022] GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c => generated 1465 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:36:18.359594 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-65817824-60ee-4955-9bbb-52449bdd43c9 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:36:18.360102 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-65817824-60ee-4955-9bbb-52449bdd43c9 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] [instance: c81ffceb-428d-4067-a52c-22cda52ad95c] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:36:18.366855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-65817824-60ee-4955-9bbb-52449bdd43c9 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:18.367251 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-65817824-60ee-4955-9bbb-52449bdd43c9 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:18.368015 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-65817824-60ee-4955-9bbb-52449bdd43c9 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:18.368850 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-65817824-60ee-4955-9bbb-52449bdd43c9 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:18.394911 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-65817824-60ee-4955-9bbb-52449bdd43c9 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] [instance: c81ffceb-428d-4067-a52c-22cda52ad95c] Going to try to terminate instance {{(pid=118025) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:36:18.674808 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-65817824-60ee-4955-9bbb-52449bdd43c9 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c" status: 204 len: 0 microversion: 2.1 time: 0.318789 Jun 22 09:36:18.675353 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 964/1880] 10.222.0.16 () {58 vars in 1238 bytes} [Wed Jun 22 09:36:18 2022] DELETE /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:36:18.684013 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-18f4e1c3-8de1-4a9d-81d6-91ccb1cb714e tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:36:18.684630 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-18f4e1c3-8de1-4a9d-81d6-91ccb1cb714e tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] [instance: c81ffceb-428d-4067-a52c-22cda52ad95c] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:36:18.690928 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-18f4e1c3-8de1-4a9d-81d6-91ccb1cb714e tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:18.691377 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-18f4e1c3-8de1-4a9d-81d6-91ccb1cb714e tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:18.692138 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-18f4e1c3-8de1-4a9d-81d6-91ccb1cb714e tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:18.692583 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-18f4e1c3-8de1-4a9d-81d6-91ccb1cb714e tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:18.825886 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-18f4e1c3-8de1-4a9d-81d6-91ccb1cb714e tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65367e79fcc4034933e6f76ec04564d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ee5a981ad41518a0f9006ae90a80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:36:18.833773 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-18f4e1c3-8de1-4a9d-81d6-91ccb1cb714e tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] 10.222.0.16 "GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c" status: 200 len: 1471 microversion: 2.1 time: 0.154158 Jun 22 09:36:18.834333 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 917/1881] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:36:18 2022] GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:36:19.852591 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f42cba3e-02c2-46c6-bb0f-84b846b4b359 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:36:19.853476 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-f42cba3e-02c2-46c6-bb0f-84b846b4b359 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] [instance: c81ffceb-428d-4067-a52c-22cda52ad95c] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:36:19.860106 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f42cba3e-02c2-46c6-bb0f-84b846b4b359 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:19.860550 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f42cba3e-02c2-46c6-bb0f-84b846b4b359 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:19.861326 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f42cba3e-02c2-46c6-bb0f-84b846b4b359 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:19.861756 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f42cba3e-02c2-46c6-bb0f-84b846b4b359 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:19.999603 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-f42cba3e-02c2-46c6-bb0f-84b846b4b359 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65367e79fcc4034933e6f76ec04564d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ee5a981ad41518a0f9006ae90a80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:36:20.007368 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f42cba3e-02c2-46c6-bb0f-84b846b4b359 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] 10.222.0.16 "GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c" status: 200 len: 1471 microversion: 2.1 time: 0.159120 Jun 22 09:36:20.008042 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 965/1882] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:36:19 2022] GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c => generated 1471 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:36:21.025601 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-e0b53608-2d9b-4ab7-882d-dd82a9e563f3 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:36:21.026785 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-e0b53608-2d9b-4ab7-882d-dd82a9e563f3 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] [instance: c81ffceb-428d-4067-a52c-22cda52ad95c] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:36:21.058147 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e0b53608-2d9b-4ab7-882d-dd82a9e563f3 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:21.058606 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e0b53608-2d9b-4ab7-882d-dd82a9e563f3 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:21.059393 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e0b53608-2d9b-4ab7-882d-dd82a9e563f3 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:21.067492 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e0b53608-2d9b-4ab7-882d-dd82a9e563f3 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:21.090839 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-1415a845-3da4-45a3-b18e-daa306afe52d req-af103155-cc69-46f7-b09f-f9ccc8f97170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c81ffceb-428d-4067-a52c-22cda52ad95c", "name": "network-vif-deleted", "tag": "b4911097-b5f9-4156-a09d-df970709fafe"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:36:21.109856 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-1415a845-3da4-45a3-b18e-daa306afe52d req-af103155-cc69-46f7-b09f-f9ccc8f97170 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:21.110362 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-1415a845-3da4-45a3-b18e-daa306afe52d req-af103155-cc69-46f7-b09f-f9ccc8f97170 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:21.124673 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-1415a845-3da4-45a3-b18e-daa306afe52d req-af103155-cc69-46f7-b09f-f9ccc8f97170 service nova] Creating event network-vif-deleted:b4911097-b5f9-4156-a09d-df970709fafe for instance c81ffceb-428d-4067-a52c-22cda52ad95c on hv-cinder-84599 Jun 22 09:36:21.130661 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-1415a845-3da4-45a3-b18e-daa306afe52d req-af103155-cc69-46f7-b09f-f9ccc8f97170 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044014 Jun 22 09:36:21.131512 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 966/1883] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:36:21.158693 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-e0b53608-2d9b-4ab7-882d-dd82a9e563f3 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65367e79fcc4034933e6f76ec04564d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ee5a981ad41518a0f9006ae90a80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:36:21.168326 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-e0b53608-2d9b-4ab7-882d-dd82a9e563f3 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] 10.222.0.16 "GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c" status: 200 len: 1429 microversion: 2.1 time: 0.147145 Jun 22 09:36:21.169175 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 918/1884] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:36:21 2022] GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c => generated 1429 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:36:22.186326 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-94886e60-d960-4d12-b99b-6e02758b5f18 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:36:22.187031 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-94886e60-d960-4d12-b99b-6e02758b5f18 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] [instance: c81ffceb-428d-4067-a52c-22cda52ad95c] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:36:22.193866 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-94886e60-d960-4d12-b99b-6e02758b5f18 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:22.194414 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-94886e60-d960-4d12-b99b-6e02758b5f18 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:22.195205 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-94886e60-d960-4d12-b99b-6e02758b5f18 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:22.195637 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-94886e60-d960-4d12-b99b-6e02758b5f18 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:22.229531 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-94886e60-d960-4d12-b99b-6e02758b5f18 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:22.229984 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-94886e60-d960-4d12-b99b-6e02758b5f18 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:22.230439 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.objects.instance [None req-94886e60-d960-4d12-b99b-6e02758b5f18 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lazy-loading 'fault' on Instance uuid c81ffceb-428d-4067-a52c-22cda52ad95c {{(pid=118025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:36:22.276199 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-94886e60-d960-4d12-b99b-6e02758b5f18 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65367e79fcc4034933e6f76ec04564d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8ee5a981ad41518a0f9006ae90a80b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:36:22.283329 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-94886e60-d960-4d12-b99b-6e02758b5f18 tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] 10.222.0.16 "GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c" status: 200 len: 1305 microversion: 2.1 time: 0.101279 Jun 22 09:36:22.283920 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 967/1885] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:36:22 2022] GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c => generated 1305 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:36:23.300338 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-586e1e8e-904f-48ed-8f0a-4e9bf93c27ce tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:36:23.301104 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-586e1e8e-904f-48ed-8f0a-4e9bf93c27ce tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] [instance: c81ffceb-428d-4067-a52c-22cda52ad95c] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:36:23.308774 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-586e1e8e-904f-48ed-8f0a-4e9bf93c27ce tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:23.309506 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-586e1e8e-904f-48ed-8f0a-4e9bf93c27ce tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:23.310663 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-586e1e8e-904f-48ed-8f0a-4e9bf93c27ce tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:36:23.311489 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-586e1e8e-904f-48ed-8f0a-4e9bf93c27ce tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:36:23.326400 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.wsgi [None req-586e1e8e-904f-48ed-8f0a-4e9bf93c27ce tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] HTTP exception thrown: Instance c81ffceb-428d-4067-a52c-22cda52ad95c could not be found. Jun 22 09:36:23.328035 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-586e1e8e-904f-48ed-8f0a-4e9bf93c27ce tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Request method failure captured: Jun 22 09:36:23.328035 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: request: GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c HTTP/1.1 Jun 22 09:36:23.328035 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept: application/json Jun 22 09:36:23.328035 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept-Encoding: identity Jun 22 09:36:23.328035 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Connection: close Jun 22 09:36:23.328035 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Length: 0 Jun 22 09:36:23.328035 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Type: application/json Jun 22 09:36:23.328035 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Host: 10.222.0.16 Jun 22 09:36:23.328035 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Openstack-System-Scope: None Jun 22 09:36:23.328035 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: User-Agent: python-urllib3/1.26.9 Jun 22 09:36:23.328035 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Auth-Token: gAAAAABisuKBUQzIFm7Bk_HWKjuI4hpXg3bmGLpiB4-2vUc7iA8ATwERnHMq44VUpBV6lOtOGayP4ebKvZkwNPEdDNDUA62fypnfNfrRK-Qx75w9Y3qEsb0V17BYA-32p188S-funXs98wPxldc6S9CRuqE45McDiHPhGl3ntCXNS5aYvKcWeZM Jun 22 09:36:23.328035 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Id: None Jun 22 09:36:23.328035 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Name: None Jun 22 09:36:23.328035 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Identity-Status: Confirmed Jun 22 09:36:23.328035 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Is-Admin-Project: True Jun 22 09:36:23.328035 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Id: default Jun 22 09:36:23.328035 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Name: Default Jun 22 09:36:23.328035 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Id: cf8ee5a981ad41518a0f9006ae90a80b Jun 22 09:36:23.328035 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Name: tempest-VolumesNegativeTest-1486306315 Jun 22 09:36:23.328035 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Role: member,reader Jun 22 09:36:23.328035 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Roles: member,reader Jun 22 09:36:23.329482 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf8ee5a981ad41518a0f9006ae90a80b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf8ee5a981ad41518a0f9006ae90a80b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cf8ee5a981ad41518a0f9006ae90a80b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cf8ee5a981ad41518a0f9006ae90a80b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:36:23.329482 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant: tempest-VolumesNegativeTest-1486306315 Jun 22 09:36:23.329482 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Id: cf8ee5a981ad41518a0f9006ae90a80b Jun 22 09:36:23.329482 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Name: tempest-VolumesNegativeTest-1486306315 Jun 22 09:36:23.329482 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User: tempest-VolumesNegativeTest-1486306315-project Jun 22 09:36:23.329482 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Id: default Jun 22 09:36:23.329482 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Name: Default Jun 22 09:36:23.329482 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Id: c65367e79fcc4034933e6f76ec04564d Jun 22 09:36:23.329482 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Name: tempest-VolumesNegativeTest-1486306315-project Jun 22 09:36:23.329482 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: method: > Jun 22 09:36:23.329482 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: exception: Instance c81ffceb-428d-4067-a52c-22cda52ad95c could not be found. Jun 22 09:36:23.329482 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: action_args: {'id': 'c81ffceb-428d-4067-a52c-22cda52ad95c'} Jun 22 09:36:23.330344 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:36:23.330344 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:36:23.330344 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:36:23.330344 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:36:23.330344 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:36:23.330344 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:36:23.330344 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:36:23.330344 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:36:23.330344 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:36:23.330344 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:36:23.330344 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c81ffceb-428d-4067-a52c-22cda52ad95c could not be found. Jun 22 09:36:23.330344 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:36:23.330344 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:36:23.330344 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:36:23.330344 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:36:23.330344 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:36:23.330344 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:36:23.330344 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:36:23.330344 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:36:23.330344 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:36:23.331782 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:36:23.331782 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:36:23.331782 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:36:23.331782 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:36:23.331782 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:36:23.331782 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:36:23.331782 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:36:23.331782 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c81ffceb-428d-4067-a52c-22cda52ad95c could not be found. Jun 22 09:36:23.331782 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:36:23.331782 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:36:23.331782 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:36:23.331782 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:36:23.331782 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:36:23.331782 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:36:23.331782 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:36:23.331782 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:36:23.331782 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c81ffceb-428d-4067-a52c-22cda52ad95c could not be found. Jun 22 09:36:23.331782 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:36:23.333009 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-586e1e8e-904f-48ed-8f0a-4e9bf93c27ce tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] Returning 404 to user: Instance c81ffceb-428d-4067-a52c-22cda52ad95c could not be found. {{(pid=118024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:36:23.333009 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-586e1e8e-904f-48ed-8f0a-4e9bf93c27ce tempest-VolumesNegativeTest-1486306315 tempest-VolumesNegativeTest-1486306315-project] 10.222.0.16 "GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c" status: 404 len: 111 microversion: 2.1 time: 0.033047 Jun 22 09:36:23.333009 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 919/1886] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:36:23 2022] GET /compute/v2.1/servers/c81ffceb-428d-4067-a52c-22cda52ad95c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:36:37.151598 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:36:37.152195 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Wed Jun 22 09:36:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:36:43.284649 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:36:43.286017 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:36:43.475071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-b8a8b2de-77e4-4cab-be50-e6ffb05df84e tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Action: 'create', calling method: .version_select at 0x7f5756221790>, body: {"keypair": {"name": "tempest-TestShelveInstance-2000839962", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+fYYcABIkhdXcbxtr9zKLaCkw6rUChG4SQwVBZ3z+h+l5W6uzjmEGqXTRE7uifOgI/4l5QunAmqPKWir0EpE1xZhVWrVXh0BhFZq+l3Qxmj4g2FxKTbeoZ9iyOhjmxFA=="}} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:36:43.490398 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.quota [None req-b8a8b2de-77e4-4cab-be50-e6ffb05df84e tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Getting quotas for project d1bb6b50eb7c4d89908ad40e63573977. Resources: {'key_pairs'} {{(pid=118025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:36:43.494905 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.quota [None req-b8a8b2de-77e4-4cab-be50-e6ffb05df84e tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Getting quotas for user 5526efb1bcac430daea4414450f27a8b and project d1bb6b50eb7c4d89908ad40e63573977. Resources: {'key_pairs'} {{(pid=118025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:36:43.603228 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-b8a8b2de-77e4-4cab-be50-e6ffb05df84e tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.323359 Jun 22 09:36:43.603873 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 968/1887] 10.222.0.16 () {60 vars in 1158 bytes} [Wed Jun 22 09:36:43 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:37:10.727938 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-afa6bcb7-a0ec-476c-a20e-9ccb93db106a tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:37:10.729137 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-afa6bcb7-a0ec-476c-a20e-9ccb93db106a tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:37:10.732379 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=13 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:37:10.733041 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=60 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:37:10.738468 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-afa6bcb7-a0ec-476c-a20e-9ccb93db106a tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:10.747621 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-afa6bcb7-a0ec-476c-a20e-9ccb93db106a tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:10.747621 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-afa6bcb7-a0ec-476c-a20e-9ccb93db106a tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:10.747621 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-afa6bcb7-a0ec-476c-a20e-9ccb93db106a tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:11.002552 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-afa6bcb7-a0ec-476c-a20e-9ccb93db106a tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "POST /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285/action" status: 202 len: 0 microversion: 2.1 time: 0.278558 Jun 22 09:37:11.004112 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 920/1888] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jun 22 09:37:10 2022] POST /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:37:11.008579 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell0:SELECT=4 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:37:11.009520 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:37:11.014100 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-98241d51-189e-4887-89c7-fd468ff720af tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:37:11.015078 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-98241d51-189e-4887-89c7-fd468ff720af tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:37:11.023172 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-98241d51-189e-4887-89c7-fd468ff720af tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:11.023635 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-98241d51-189e-4887-89c7-fd468ff720af tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:11.024683 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-98241d51-189e-4887-89c7-fd468ff720af tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:11.025168 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-98241d51-189e-4887-89c7-fd468ff720af tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:11.193781 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-98241d51-189e-4887-89c7-fd468ff720af tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:37:11.203187 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-98241d51-189e-4887-89c7-fd468ff720af tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1753 microversion: 2.1 time: 0.195823 Jun 22 09:37:11.203687 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 969/1889] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:37:11 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1753 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:37:12.222621 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-be033483-571e-4849-82eb-cb1e138bc663 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:37:12.223332 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-be033483-571e-4849-82eb-cb1e138bc663 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:37:12.230470 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-be033483-571e-4849-82eb-cb1e138bc663 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:12.230919 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-be033483-571e-4849-82eb-cb1e138bc663 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:12.231696 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-be033483-571e-4849-82eb-cb1e138bc663 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:12.232178 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-be033483-571e-4849-82eb-cb1e138bc663 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:12.389353 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-be033483-571e-4849-82eb-cb1e138bc663 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:37:12.397833 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-be033483-571e-4849-82eb-cb1e138bc663 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1758 microversion: 2.1 time: 0.180084 Jun 22 09:37:12.398402 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 921/1890] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:37:12 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:37:13.415891 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7d9b2876-e1c9-4621-8edd-b56d5ce8781c tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:37:13.416442 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7d9b2876-e1c9-4621-8edd-b56d5ce8781c tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:37:13.423387 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7d9b2876-e1c9-4621-8edd-b56d5ce8781c tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:13.423829 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7d9b2876-e1c9-4621-8edd-b56d5ce8781c tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:13.424638 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7d9b2876-e1c9-4621-8edd-b56d5ce8781c tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:13.425103 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7d9b2876-e1c9-4621-8edd-b56d5ce8781c tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:13.582354 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7d9b2876-e1c9-4621-8edd-b56d5ce8781c tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:37:13.590566 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7d9b2876-e1c9-4621-8edd-b56d5ce8781c tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1758 microversion: 2.1 time: 0.178943 Jun 22 09:37:13.591148 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 970/1891] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:37:13 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:37:14.607953 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-74a1c53d-8354-4678-a19c-8af10fd761d8 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:37:14.608563 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-74a1c53d-8354-4678-a19c-8af10fd761d8 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:37:14.615229 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-74a1c53d-8354-4678-a19c-8af10fd761d8 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:14.615671 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-74a1c53d-8354-4678-a19c-8af10fd761d8 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:14.616436 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-74a1c53d-8354-4678-a19c-8af10fd761d8 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:14.616898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-74a1c53d-8354-4678-a19c-8af10fd761d8 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:14.769578 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-74a1c53d-8354-4678-a19c-8af10fd761d8 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:37:14.780517 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-74a1c53d-8354-4678-a19c-8af10fd761d8 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1758 microversion: 2.1 time: 0.176910 Jun 22 09:37:14.781133 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 922/1892] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:37:14 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1758 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:37:15.801490 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-51989ad2-390c-476d-99ba-f1a6bf72e26d tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:37:15.802116 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-51989ad2-390c-476d-99ba-f1a6bf72e26d tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:37:15.809568 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-51989ad2-390c-476d-99ba-f1a6bf72e26d tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:15.810025 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-51989ad2-390c-476d-99ba-f1a6bf72e26d tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:15.810806 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-51989ad2-390c-476d-99ba-f1a6bf72e26d tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:15.811259 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-51989ad2-390c-476d-99ba-f1a6bf72e26d tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:15.975983 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-51989ad2-390c-476d-99ba-f1a6bf72e26d tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:37:15.985196 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-51989ad2-390c-476d-99ba-f1a6bf72e26d tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1758 microversion: 2.1 time: 0.190030 Jun 22 09:37:15.985804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 971/1893] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:37:15 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1758 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:37:17.004340 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-8dd14d2e-a55f-481a-98ff-24d1fe9878c9 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:37:17.004987 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-8dd14d2e-a55f-481a-98ff-24d1fe9878c9 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:37:17.012086 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8dd14d2e-a55f-481a-98ff-24d1fe9878c9 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:17.012544 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8dd14d2e-a55f-481a-98ff-24d1fe9878c9 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:17.013375 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8dd14d2e-a55f-481a-98ff-24d1fe9878c9 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:17.013816 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8dd14d2e-a55f-481a-98ff-24d1fe9878c9 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:17.176383 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-8dd14d2e-a55f-481a-98ff-24d1fe9878c9 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:37:17.186032 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-8dd14d2e-a55f-481a-98ff-24d1fe9878c9 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1758 microversion: 2.1 time: 0.186312 Jun 22 09:37:17.187370 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 923/1894] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:37:16 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1758 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:37:17.768711 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d5a14d91-e5b5-4454-8f3d-d88e104b8cac tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1736590952", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2000839962", "security_groups": [{"name": "tempest-secgroup-smoke-822357508"}], "networks": [{"uuid": "4b8fb23d-385f-4256-b049-38f4a59daec2"}], "block_device_mapping_v2": [{"uuid": "55f2f8c7-e5ad-4e92-89da-753b2f353f78", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:37:17.885519 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.network.neutron [None req-d5a14d91-e5b5-4454-8f3d-d88e104b8cac tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] validate_networks() for [('4b8fb23d-385f-4256-b049-38f4a59daec2', None, None, None, None, None)] {{(pid=118025) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:37:18.205891 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-2ef6f4d9-f43b-467a-9455-8c8de332a200 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:37:18.206619 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-2ef6f4d9-f43b-467a-9455-8c8de332a200 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:37:18.214293 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2ef6f4d9-f43b-467a-9455-8c8de332a200 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:18.217925 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2ef6f4d9-f43b-467a-9455-8c8de332a200 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:18.217925 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2ef6f4d9-f43b-467a-9455-8c8de332a200 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:18.217925 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2ef6f4d9-f43b-467a-9455-8c8de332a200 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:18.346684 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-d5a14d91-e5b5-4454-8f3d-d88e104b8cac tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Flavor limits 0:0:0 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:37:18.347147 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-d5a14d91-e5b5-4454-8f3d-d88e104b8cac tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Image limits 0:0:0 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:37:18.347657 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-d5a14d91-e5b5-4454-8f3d-d88e104b8cac tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Flavor pref 0:0:0 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:37:18.348072 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-d5a14d91-e5b5-4454-8f3d-d88e104b8cac tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Image pref 0:0:0 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:37:18.348490 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.virt.hardware [None req-d5a14d91-e5b5-4454-8f3d-d88e104b8cac tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:37:18.359179 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d5a14d91-e5b5-4454-8f3d-d88e104b8cac tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:18.359636 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d5a14d91-e5b5-4454-8f3d-d88e104b8cac tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:18.360454 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d5a14d91-e5b5-4454-8f3d-d88e104b8cac tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:18.360921 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d5a14d91-e5b5-4454-8f3d-d88e104b8cac tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:18.389827 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.quota [None req-d5a14d91-e5b5-4454-8f3d-d88e104b8cac tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Getting quotas for project d1bb6b50eb7c4d89908ad40e63573977. Resources: {'cores', 'instances', 'ram'} {{(pid=118025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:37:18.395409 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.quota [None req-d5a14d91-e5b5-4454-8f3d-d88e104b8cac tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Getting quotas for user 5526efb1bcac430daea4414450f27a8b and project d1bb6b50eb7c4d89908ad40e63573977. Resources: {'cores', 'instances', 'ram'} {{(pid=118025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:37:18.429681 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-2ef6f4d9-f43b-467a-9455-8c8de332a200 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:37:18.443793 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-2ef6f4d9-f43b-467a-9455-8c8de332a200 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1758 microversion: 2.1 time: 0.241713 Jun 22 09:37:18.444499 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 924/1895] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:37:18 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1758 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:37:18.473053 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-d5a14d91-e5b5-4454-8f3d-d88e104b8cac tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Going to run 1 instances... {{(pid=118025) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:37:18.475466 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-d5a14d91-e5b5-4454-8f3d-d88e104b8cac tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='55f2f8c7-e5ad-4e92-89da-753b2f353f78',volume_size=None,volume_type=None)] {{(pid=118025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:37:18.954437 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d5a14d91-e5b5-4454-8f3d-d88e104b8cac tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.189431 Jun 22 09:37:18.955300 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 972/1896] 10.222.0.16 () {60 vars in 1146 bytes} [Wed Jun 22 09:37:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 1191 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 09:37:18.965884 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-9187cae2-2827-48fd-b25d-b534bcf8116f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:37:18.966503 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-9187cae2-2827-48fd-b25d-b534bcf8116f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:37:19.023063 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-9187cae2-2827-48fd-b25d-b534bcf8116f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:37:19.031031 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-9187cae2-2827-48fd-b25d-b534bcf8116f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1089 microversion: 2.1 time: 0.069499 Jun 22 09:37:19.031844 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 925/1897] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:37:18 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1089 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:37:19.463695 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-1421267f-e28b-4098-90fd-7738f82f96c1 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:37:19.465108 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-1421267f-e28b-4098-90fd-7738f82f96c1 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:37:19.472042 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1421267f-e28b-4098-90fd-7738f82f96c1 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:19.472574 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1421267f-e28b-4098-90fd-7738f82f96c1 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:19.473473 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1421267f-e28b-4098-90fd-7738f82f96c1 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:19.473988 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1421267f-e28b-4098-90fd-7738f82f96c1 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:19.624461 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-1421267f-e28b-4098-90fd-7738f82f96c1 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:37:19.633245 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-1421267f-e28b-4098-90fd-7738f82f96c1 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1758 microversion: 2.1 time: 0.174045 Jun 22 09:37:19.633839 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 973/1898] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:37:19 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:37:20.048384 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-557cc9c5-0f53-48d7-93c7-3a487c9d1ecc tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:37:20.049056 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-557cc9c5-0f53-48d7-93c7-3a487c9d1ecc tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:37:20.104078 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-557cc9c5-0f53-48d7-93c7-3a487c9d1ecc tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:37:20.112162 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-557cc9c5-0f53-48d7-93c7-3a487c9d1ecc tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1089 microversion: 2.1 time: 0.067889 Jun 22 09:37:20.112720 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 926/1899] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:37:20 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1089 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:37:20.651381 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7edf41bb-98a9-47f6-858b-7663cd8a4f3c tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:37:20.651909 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7edf41bb-98a9-47f6-858b-7663cd8a4f3c tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:37:20.659134 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7edf41bb-98a9-47f6-858b-7663cd8a4f3c tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:20.659587 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7edf41bb-98a9-47f6-858b-7663cd8a4f3c tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:20.660357 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7edf41bb-98a9-47f6-858b-7663cd8a4f3c tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:20.660827 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7edf41bb-98a9-47f6-858b-7663cd8a4f3c tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:20.817899 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7edf41bb-98a9-47f6-858b-7663cd8a4f3c tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:37:20.826322 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7edf41bb-98a9-47f6-858b-7663cd8a4f3c tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1758 microversion: 2.1 time: 0.178898 Jun 22 09:37:20.826891 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 974/1900] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:37:20 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:37:21.130266 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-7365dbfb-7c68-4f3e-93ad-299fec8cbcee tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:37:21.130883 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-7365dbfb-7c68-4f3e-93ad-299fec8cbcee tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:37:21.139294 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7365dbfb-7c68-4f3e-93ad-299fec8cbcee tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:21.139741 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7365dbfb-7c68-4f3e-93ad-299fec8cbcee tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:21.140528 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7365dbfb-7c68-4f3e-93ad-299fec8cbcee tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:21.141009 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7365dbfb-7c68-4f3e-93ad-299fec8cbcee tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:21.211262 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-7365dbfb-7c68-4f3e-93ad-299fec8cbcee tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:37:21.219699 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-7365dbfb-7c68-4f3e-93ad-299fec8cbcee tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1187 microversion: 2.1 time: 0.093372 Jun 22 09:37:21.220283 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 927/1901] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:37:21 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1187 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:37:21.843507 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-af7484ec-245f-483e-9068-c5e0bee8bd01 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:37:21.844238 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-af7484ec-245f-483e-9068-c5e0bee8bd01 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:37:21.851427 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-af7484ec-245f-483e-9068-c5e0bee8bd01 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:21.851878 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-af7484ec-245f-483e-9068-c5e0bee8bd01 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:21.852670 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-af7484ec-245f-483e-9068-c5e0bee8bd01 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:21.853186 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-af7484ec-245f-483e-9068-c5e0bee8bd01 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:22.007523 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-af7484ec-245f-483e-9068-c5e0bee8bd01 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:37:22.021404 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-af7484ec-245f-483e-9068-c5e0bee8bd01 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1758 microversion: 2.1 time: 0.181426 Jun 22 09:37:22.022609 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 975/1902] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:37:21 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1758 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:37:22.238820 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c4541057-067b-42ba-96d4-2204f8a723c6 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:37:22.239505 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c4541057-067b-42ba-96d4-2204f8a723c6 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:37:22.249391 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c4541057-067b-42ba-96d4-2204f8a723c6 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:22.249864 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c4541057-067b-42ba-96d4-2204f8a723c6 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:22.250729 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c4541057-067b-42ba-96d4-2204f8a723c6 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:22.251173 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c4541057-067b-42ba-96d4-2204f8a723c6 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:22.418310 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-c4541057-067b-42ba-96d4-2204f8a723c6 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:37:22.428387 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c4541057-067b-42ba-96d4-2204f8a723c6 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1272 microversion: 2.1 time: 0.194295 Jun 22 09:37:22.429088 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 928/1903] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:37:22 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1272 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:37:23.039989 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2dbb2a68-3a52-4f65-88ce-251b1270ac54 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:37:23.040771 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2dbb2a68-3a52-4f65-88ce-251b1270ac54 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:37:23.049183 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2dbb2a68-3a52-4f65-88ce-251b1270ac54 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:23.049754 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2dbb2a68-3a52-4f65-88ce-251b1270ac54 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:23.050647 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2dbb2a68-3a52-4f65-88ce-251b1270ac54 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:23.051266 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2dbb2a68-3a52-4f65-88ce-251b1270ac54 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:23.219968 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-2dbb2a68-3a52-4f65-88ce-251b1270ac54 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:37:23.232367 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2dbb2a68-3a52-4f65-88ce-251b1270ac54 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1761 microversion: 2.1 time: 0.196550 Jun 22 09:37:23.233100 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 976/1904] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:37:23 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1761 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:37:23.448407 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ef4268d4-9712-41fe-98b3-035138852f51 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:37:23.449563 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ef4268d4-9712-41fe-98b3-035138852f51 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:37:23.456842 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ef4268d4-9712-41fe-98b3-035138852f51 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:23.457302 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ef4268d4-9712-41fe-98b3-035138852f51 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:23.458085 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ef4268d4-9712-41fe-98b3-035138852f51 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:23.458544 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ef4268d4-9712-41fe-98b3-035138852f51 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:23.555501 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-c52f0f8d-971a-486a-a36e-a489f6a3c530 req-cc1bc331-5b0b-4b83-ab53-24303e0a2200 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dce7006-cd1a-47c6-8277-069dd009e5e6", "tag": "7f926d08-fc86-4232-a70c-16322f636aa5"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:37:23.568753 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-c52f0f8d-971a-486a-a36e-a489f6a3c530 req-cc1bc331-5b0b-4b83-ab53-24303e0a2200 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:23.576447 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-c52f0f8d-971a-486a-a36e-a489f6a3c530 req-cc1bc331-5b0b-4b83-ab53-24303e0a2200 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:23.584537 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-c52f0f8d-971a-486a-a36e-a489f6a3c530 req-cc1bc331-5b0b-4b83-ab53-24303e0a2200 service nova] Creating event network-changed:7f926d08-fc86-4232-a70c-16322f636aa5 for instance 7dce7006-cd1a-47c6-8277-069dd009e5e6 on hv-cinder-84599 Jun 22 09:37:23.592053 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-c52f0f8d-971a-486a-a36e-a489f6a3c530 req-cc1bc331-5b0b-4b83-ab53-24303e0a2200 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044476 Jun 22 09:37:23.592999 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 977/1905] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:37:23.647206 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ef4268d4-9712-41fe-98b3-035138852f51 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:37:23.663490 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ef4268d4-9712-41fe-98b3-035138852f51 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1272 microversion: 2.1 time: 0.219131 Jun 22 09:37:23.664771 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 929/1906] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:37:23 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1272 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:37:24.682505 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-c0bb4cf0-82e1-4884-b53f-78ae5536f09b tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:37:24.683096 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-c0bb4cf0-82e1-4884-b53f-78ae5536f09b tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:37:24.690626 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c0bb4cf0-82e1-4884-b53f-78ae5536f09b tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:24.691069 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c0bb4cf0-82e1-4884-b53f-78ae5536f09b tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:24.691828 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c0bb4cf0-82e1-4884-b53f-78ae5536f09b tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:24.692260 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-c0bb4cf0-82e1-4884-b53f-78ae5536f09b tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:24.857945 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-c0bb4cf0-82e1-4884-b53f-78ae5536f09b tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:37:24.866201 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-c0bb4cf0-82e1-4884-b53f-78ae5536f09b tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1260 microversion: 2.1 time: 0.188023 Jun 22 09:37:24.866768 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 978/1907] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:37:24 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:37:25.888838 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-23b60878-8144-4695-b3d7-c8e85406379b tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:37:25.894178 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-23b60878-8144-4695-b3d7-c8e85406379b tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:37:25.901402 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-23b60878-8144-4695-b3d7-c8e85406379b tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:25.905682 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-23b60878-8144-4695-b3d7-c8e85406379b tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:25.907358 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-23b60878-8144-4695-b3d7-c8e85406379b tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:25.908002 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-23b60878-8144-4695-b3d7-c8e85406379b tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:26.067501 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-23b60878-8144-4695-b3d7-c8e85406379b tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:37:26.075869 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-23b60878-8144-4695-b3d7-c8e85406379b tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1260 microversion: 2.1 time: 0.195111 Jun 22 09:37:26.076543 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 930/1908] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:37:25 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1260 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:37:27.093295 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f4bc40eb-cb45-4674-95b5-d0cae5060068 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:37:27.093973 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-f4bc40eb-cb45-4674-95b5-d0cae5060068 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:37:27.101076 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f4bc40eb-cb45-4674-95b5-d0cae5060068 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:27.101560 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f4bc40eb-cb45-4674-95b5-d0cae5060068 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:27.102283 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f4bc40eb-cb45-4674-95b5-d0cae5060068 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:27.102766 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f4bc40eb-cb45-4674-95b5-d0cae5060068 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:27.239357 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-f4bc40eb-cb45-4674-95b5-d0cae5060068 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:37:27.246868 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f4bc40eb-cb45-4674-95b5-d0cae5060068 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1260 microversion: 2.1 time: 0.157850 Jun 22 09:37:27.247917 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 979/1909] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:37:27 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:37:28.265384 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ec634d5f-0c80-4b99-b7fa-6f6c530f74f7 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:37:28.265952 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ec634d5f-0c80-4b99-b7fa-6f6c530f74f7 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:37:28.272729 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ec634d5f-0c80-4b99-b7fa-6f6c530f74f7 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:28.273213 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ec634d5f-0c80-4b99-b7fa-6f6c530f74f7 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:28.273993 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ec634d5f-0c80-4b99-b7fa-6f6c530f74f7 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:28.274436 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ec634d5f-0c80-4b99-b7fa-6f6c530f74f7 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:28.418762 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ec634d5f-0c80-4b99-b7fa-6f6c530f74f7 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:37:28.427218 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ec634d5f-0c80-4b99-b7fa-6f6c530f74f7 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1260 microversion: 2.1 time: 0.166945 Jun 22 09:37:28.427791 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 931/1910] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:37:28 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:37:29.444925 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-1ddd269f-72dc-48ed-a626-e7cbd9fd25e0 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:37:29.445573 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-1ddd269f-72dc-48ed-a626-e7cbd9fd25e0 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:37:29.447987 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell0:SELECT=2 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:37:29.448654 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell0:SELECT=6 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:37:29.454826 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1ddd269f-72dc-48ed-a626-e7cbd9fd25e0 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:29.455276 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1ddd269f-72dc-48ed-a626-e7cbd9fd25e0 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:29.456048 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1ddd269f-72dc-48ed-a626-e7cbd9fd25e0 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:29.456478 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1ddd269f-72dc-48ed-a626-e7cbd9fd25e0 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:29.610121 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-1ddd269f-72dc-48ed-a626-e7cbd9fd25e0 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:37:29.617668 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-1ddd269f-72dc-48ed-a626-e7cbd9fd25e0 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1260 microversion: 2.1 time: 0.176590 Jun 22 09:37:29.618234 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 980/1911] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:37:29 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:37:30.634582 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-5c8a5d75-83b0-4ad0-8712-34402aea0f2e tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:37:30.635195 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-5c8a5d75-83b0-4ad0-8712-34402aea0f2e tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:37:30.637360 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell0:SELECT=4 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:37:30.642810 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5c8a5d75-83b0-4ad0-8712-34402aea0f2e tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:30.643268 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5c8a5d75-83b0-4ad0-8712-34402aea0f2e tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:30.644059 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5c8a5d75-83b0-4ad0-8712-34402aea0f2e tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:30.644501 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-5c8a5d75-83b0-4ad0-8712-34402aea0f2e tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:30.789643 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-5c8a5d75-83b0-4ad0-8712-34402aea0f2e tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:37:30.797518 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-5c8a5d75-83b0-4ad0-8712-34402aea0f2e tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1260 microversion: 2.1 time: 0.166831 Jun 22 09:37:30.798079 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 932/1912] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:37:30 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:37:31.814136 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-db7ee465-d0c8-4b98-b25e-52cd032ae836 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:37:31.814794 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-db7ee465-d0c8-4b98-b25e-52cd032ae836 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:37:31.822096 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-db7ee465-d0c8-4b98-b25e-52cd032ae836 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:31.831547 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-db7ee465-d0c8-4b98-b25e-52cd032ae836 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:31.831547 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-db7ee465-d0c8-4b98-b25e-52cd032ae836 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:31.831547 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-db7ee465-d0c8-4b98-b25e-52cd032ae836 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:31.967867 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-db7ee465-d0c8-4b98-b25e-52cd032ae836 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:37:31.975942 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-db7ee465-d0c8-4b98-b25e-52cd032ae836 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1260 microversion: 2.1 time: 0.165786 Jun 22 09:37:31.980527 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 981/1913] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:37:31 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:37:32.996458 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-985089cd-8625-4fe3-9d06-ddca69b5ccaf tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:37:32.997057 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-985089cd-8625-4fe3-9d06-ddca69b5ccaf tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:37:33.004812 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-985089cd-8625-4fe3-9d06-ddca69b5ccaf tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:33.005270 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-985089cd-8625-4fe3-9d06-ddca69b5ccaf tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:33.006036 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-985089cd-8625-4fe3-9d06-ddca69b5ccaf tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:33.006469 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-985089cd-8625-4fe3-9d06-ddca69b5ccaf tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:33.141496 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-985089cd-8625-4fe3-9d06-ddca69b5ccaf tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:37:33.149037 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-985089cd-8625-4fe3-9d06-ddca69b5ccaf tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1260 microversion: 2.1 time: 0.157037 Jun 22 09:37:33.149599 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 933/1914] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:37:32 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:37:33.985914 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-2260b04b-1872-4218-b107-942791168c1f req-3eafbbd1-aa3c-491c-b6a1-870916b99458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dce7006-cd1a-47c6-8277-069dd009e5e6", "name": "network-vif-plugged", "status": "completed", "tag": "7f926d08-fc86-4232-a70c-16322f636aa5"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:37:33.994609 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-2260b04b-1872-4218-b107-942791168c1f req-3eafbbd1-aa3c-491c-b6a1-870916b99458 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:33.995059 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-2260b04b-1872-4218-b107-942791168c1f req-3eafbbd1-aa3c-491c-b6a1-870916b99458 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:34.007227 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-2260b04b-1872-4218-b107-942791168c1f req-3eafbbd1-aa3c-491c-b6a1-870916b99458 service nova] Creating event network-vif-plugged:7f926d08-fc86-4232-a70c-16322f636aa5 for instance 7dce7006-cd1a-47c6-8277-069dd009e5e6 on hv-cinder-84599 Jun 22 09:37:34.012235 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-2260b04b-1872-4218-b107-942791168c1f req-3eafbbd1-aa3c-491c-b6a1-870916b99458 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030896 Jun 22 09:37:34.013585 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 982/1915] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:37:34.166939 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-ff4d1509-9e0b-4f4a-a997-309d70ec1288 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:37:34.167582 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-ff4d1509-9e0b-4f4a-a997-309d70ec1288 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:37:34.173960 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ff4d1509-9e0b-4f4a-a997-309d70ec1288 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:34.174408 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ff4d1509-9e0b-4f4a-a997-309d70ec1288 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:34.175176 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ff4d1509-9e0b-4f4a-a997-309d70ec1288 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:34.175618 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-ff4d1509-9e0b-4f4a-a997-309d70ec1288 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:34.312518 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-ff4d1509-9e0b-4f4a-a997-309d70ec1288 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:37:34.320252 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-ff4d1509-9e0b-4f4a-a997-309d70ec1288 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1260 microversion: 2.1 time: 0.157486 Jun 22 09:37:34.320834 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 934/1916] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:37:34 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:37:35.339012 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-8746fd08-9f54-4c9c-b634-ca307331571c tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:37:35.339702 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-8746fd08-9f54-4c9c-b634-ca307331571c tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:37:35.346864 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8746fd08-9f54-4c9c-b634-ca307331571c tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:35.347304 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8746fd08-9f54-4c9c-b634-ca307331571c tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:35.348039 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8746fd08-9f54-4c9c-b634-ca307331571c tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:35.348476 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8746fd08-9f54-4c9c-b634-ca307331571c tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:35.483167 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-8746fd08-9f54-4c9c-b634-ca307331571c tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:37:35.491463 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-8746fd08-9f54-4c9c-b634-ca307331571c tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1260 microversion: 2.1 time: 0.157111 Jun 22 09:37:35.492024 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 983/1917] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:37:35 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:37:36.508016 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c0393463-0207-4bb5-ae26-e910a710e34d tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:37:36.508618 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c0393463-0207-4bb5-ae26-e910a710e34d tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:37:36.515533 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c0393463-0207-4bb5-ae26-e910a710e34d tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:36.520484 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c0393463-0207-4bb5-ae26-e910a710e34d tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:36.520484 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c0393463-0207-4bb5-ae26-e910a710e34d tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:36.520484 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c0393463-0207-4bb5-ae26-e910a710e34d tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:36.907971 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-c0393463-0207-4bb5-ae26-e910a710e34d tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:37:36.915887 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c0393463-0207-4bb5-ae26-e910a710e34d tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1443 microversion: 2.1 time: 0.411668 Jun 22 09:37:36.916472 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 935/1918] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:37:36 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1443 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:37:36.933711 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-1a88fb4b-5fa9-4594-a33e-87077a2afb2a tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:37:36.934373 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-1a88fb4b-5fa9-4594-a33e-87077a2afb2a tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:37:36.941261 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1a88fb4b-5fa9-4594-a33e-87077a2afb2a tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:36.943807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1a88fb4b-5fa9-4594-a33e-87077a2afb2a tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:36.943807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1a88fb4b-5fa9-4594-a33e-87077a2afb2a tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:36.943807 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1a88fb4b-5fa9-4594-a33e-87077a2afb2a tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:37.080055 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-1a88fb4b-5fa9-4594-a33e-87077a2afb2a tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:37:37.087619 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-1a88fb4b-5fa9-4594-a33e-87077a2afb2a tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1443 microversion: 2.1 time: 0.158148 Jun 22 09:37:37.088178 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 984/1919] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:37:36 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:37:39.238113 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [req-e6f56755-6637-44e5-adb7-5c2b97f9fb49 req-e05686b0-599e-4f2f-b3d2-22b4233d376a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dce7006-cd1a-47c6-8277-069dd009e5e6", "tag": "7f926d08-fc86-4232-a70c-16322f636aa5"}]} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:37:39.246597 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-e6f56755-6637-44e5-adb7-5c2b97f9fb49 req-e05686b0-599e-4f2f-b3d2-22b4233d376a service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:37:39.247037 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-e6f56755-6637-44e5-adb7-5c2b97f9fb49 req-e05686b0-599e-4f2f-b3d2-22b4233d376a service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:37:39.258929 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.compute.server_external_events [req-e6f56755-6637-44e5-adb7-5c2b97f9fb49 req-e05686b0-599e-4f2f-b3d2-22b4233d376a service nova] Creating event network-changed:7f926d08-fc86-4232-a70c-16322f636aa5 for instance 7dce7006-cd1a-47c6-8277-069dd009e5e6 on hv-cinder-84599 Jun 22 09:37:39.264196 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [req-e6f56755-6637-44e5-adb7-5c2b97f9fb49 req-e05686b0-599e-4f2f-b3d2-22b4233d376a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031283 Jun 22 09:37:39.265072 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 936/1920] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:38:26.591406 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-3897bd7b-febc-4c1b-b60a-ea1b4ab043fc tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1674044749"}} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:38:26.592014 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-3897bd7b-febc-4c1b-b60a-ea1b4ab043fc tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:38:26.594318 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:38:26.596177 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=84 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:38:26.600853 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3897bd7b-febc-4c1b-b60a-ea1b4ab043fc tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:38:26.601304 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3897bd7b-febc-4c1b-b60a-ea1b4ab043fc tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:38:26.602074 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3897bd7b-febc-4c1b-b60a-ea1b4ab043fc tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:38:26.602511 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-3897bd7b-febc-4c1b-b60a-ea1b4ab043fc tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:38:26.737092 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.network.security_group_api [None req-3897bd7b-febc-4c1b-b60a-ea1b4ab043fc tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Removing security group 40ab409d-dfb4-438c-88ac-6103afa07e35 from port bdb6db07-5143-42e2-bb43-ef3b56c62ba1 Jun 22 09:38:27.192220 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-3897bd7b-febc-4c1b-b60a-ea1b4ab043fc tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "POST /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285/action" status: 202 len: 0 microversion: 2.1 time: 0.604844 Jun 22 09:38:27.194571 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 985/1921] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jun 22 09:38:26 2022] POST /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285/action => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:38:27.229844 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [req-210d0c6c-477f-4922-82e0-228f8a388c9d req-4d14fe6a-659f-4334-af3b-37031956f705 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e8c5a28-f8ae-45eb-bbf9-b28ae208c285", "tag": "bdb6db07-5143-42e2-bb43-ef3b56c62ba1"}]} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:38:27.236037 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=38 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:38:27.237770 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:38:27.252490 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-210d0c6c-477f-4922-82e0-228f8a388c9d req-4d14fe6a-659f-4334-af3b-37031956f705 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:38:27.252490 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-210d0c6c-477f-4922-82e0-228f8a388c9d req-4d14fe6a-659f-4334-af3b-37031956f705 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:38:27.275132 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.compute.server_external_events [req-210d0c6c-477f-4922-82e0-228f8a388c9d req-4d14fe6a-659f-4334-af3b-37031956f705 service nova] Creating event network-changed:bdb6db07-5143-42e2-bb43-ef3b56c62ba1 for instance 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 on hv-cinder-84599 Jun 22 09:38:27.282068 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [req-210d0c6c-477f-4922-82e0-228f8a388c9d req-4d14fe6a-659f-4334-af3b-37031956f705 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065739 Jun 22 09:38:27.282068 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 937/1922] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:38:28.572314 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-6772a4db-3f60-472a-a8b1-152b54da3a91 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:38:28.572913 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-6772a4db-3f60-472a-a8b1-152b54da3a91 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:38:28.579079 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6772a4db-3f60-472a-a8b1-152b54da3a91 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:38:28.579617 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6772a4db-3f60-472a-a8b1-152b54da3a91 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:38:28.580431 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6772a4db-3f60-472a-a8b1-152b54da3a91 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:38:28.580898 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6772a4db-3f60-472a-a8b1-152b54da3a91 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:38:28.665019 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.objects.instance [None req-6772a4db-3f60-472a-a8b1-152b54da3a91 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lazy-loading 'services' on Instance uuid 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 {{(pid=118025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:38:28.931951 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-6772a4db-3f60-472a-a8b1-152b54da3a91 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285/os-volume_attachments/47f834bf-e2c4-4957-b55a-5197249ca8e3" status: 202 len: 0 microversion: 2.1 time: 0.363427 Jun 22 09:38:28.932503 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 986/1923] 10.222.0.16 () {58 vars in 1415 bytes} [Wed Jun 22 09:38:28 2022] DELETE /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285/os-volume_attachments/47f834bf-e2c4-4957-b55a-5197249ca8e3 => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:38:28.942360 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-dff70efb-dd16-456d-aaff-5b7ffd28f916 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:38:28.943748 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-dff70efb-dd16-456d-aaff-5b7ffd28f916 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:38:28.951965 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dff70efb-dd16-456d-aaff-5b7ffd28f916 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:38:28.953569 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dff70efb-dd16-456d-aaff-5b7ffd28f916 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:38:28.953569 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dff70efb-dd16-456d-aaff-5b7ffd28f916 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:38:28.953846 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-dff70efb-dd16-456d-aaff-5b7ffd28f916 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:38:28.991741 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-dff70efb-dd16-456d-aaff-5b7ffd28f916 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054536 Jun 22 09:38:28.992331 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 938/1924] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:38:28 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:38:29.300419 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-a5b3f45b-b4f0-4162-88e4-c9fd13425bf6 req-ad4b7e57-cf9e-45c3-845d-ac62d9f7e2fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e8c5a28-f8ae-45eb-bbf9-b28ae208c285", "tag": "bdb6db07-5143-42e2-bb43-ef3b56c62ba1"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:38:29.309071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-a5b3f45b-b4f0-4162-88e4-c9fd13425bf6 req-ad4b7e57-cf9e-45c3-845d-ac62d9f7e2fd service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:38:29.309523 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-a5b3f45b-b4f0-4162-88e4-c9fd13425bf6 req-ad4b7e57-cf9e-45c3-845d-ac62d9f7e2fd service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:38:29.322752 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-a5b3f45b-b4f0-4162-88e4-c9fd13425bf6 req-ad4b7e57-cf9e-45c3-845d-ac62d9f7e2fd service nova] Creating event network-changed:bdb6db07-5143-42e2-bb43-ef3b56c62ba1 for instance 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 on hv-cinder-84599 Jun 22 09:38:29.327570 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-a5b3f45b-b4f0-4162-88e4-c9fd13425bf6 req-ad4b7e57-cf9e-45c3-845d-ac62d9f7e2fd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031775 Jun 22 09:38:29.328207 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 987/1925] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:38:30.006903 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-79171025-23d9-45f6-b5ff-7a2f3fc8c473 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:38:30.007952 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-79171025-23d9-45f6-b5ff-7a2f3fc8c473 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:38:30.015138 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-79171025-23d9-45f6-b5ff-7a2f3fc8c473 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:38:30.015693 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-79171025-23d9-45f6-b5ff-7a2f3fc8c473 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:38:30.016555 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-79171025-23d9-45f6-b5ff-7a2f3fc8c473 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:38:30.017101 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-79171025-23d9-45f6-b5ff-7a2f3fc8c473 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:38:30.068022 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-79171025-23d9-45f6-b5ff-7a2f3fc8c473 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067685 Jun 22 09:38:30.068952 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 939/1926] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:38:29 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:38:31.081710 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-dd328809-4d22-48f2-acd5-231f50bf3ae4 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:38:31.082740 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-dd328809-4d22-48f2-acd5-231f50bf3ae4 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:38:31.089433 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dd328809-4d22-48f2-acd5-231f50bf3ae4 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:38:31.089962 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dd328809-4d22-48f2-acd5-231f50bf3ae4 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:38:31.090648 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dd328809-4d22-48f2-acd5-231f50bf3ae4 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:38:31.091088 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-dd328809-4d22-48f2-acd5-231f50bf3ae4 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:38:31.121774 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-dd328809-4d22-48f2-acd5-231f50bf3ae4 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044951 Jun 22 09:38:31.122537 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 988/1927] 10.222.0.16 () {58 vars in 1301 bytes} [Wed Jun 22 09:38:31 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 09:38:31.137757 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-17cd7755-9e15-4899-8130-e0f0f49eba64 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:38:31.138296 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-17cd7755-9e15-4899-8130-e0f0f49eba64 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:38:31.149687 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-17cd7755-9e15-4899-8130-e0f0f49eba64 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:38:31.150938 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-17cd7755-9e15-4899-8130-e0f0f49eba64 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:38:31.151815 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-17cd7755-9e15-4899-8130-e0f0f49eba64 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:38:31.152323 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-17cd7755-9e15-4899-8130-e0f0f49eba64 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:38:31.241497 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.wsgi [None req-17cd7755-9e15-4899-8130-e0f0f49eba64 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] HTTP exception thrown: Instance 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 is not attached to volume 47f834bf-e2c4-4957-b55a-5197249ca8e3 Jun 22 09:38:31.244012 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-17cd7755-9e15-4899-8130-e0f0f49eba64 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Request method failure captured: Jun 22 09:38:31.244012 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: request: DELETE /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285/os-volume_attachments/47f834bf-e2c4-4957-b55a-5197249ca8e3 HTTP/1.1 Jun 22 09:38:31.244012 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept: application/json Jun 22 09:38:31.244012 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept-Encoding: identity Jun 22 09:38:31.244012 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Connection: close Jun 22 09:38:31.244012 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Length: 0 Jun 22 09:38:31.244012 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Type: application/json Jun 22 09:38:31.244012 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Host: 10.222.0.16 Jun 22 09:38:31.244012 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Openstack-System-Scope: None Jun 22 09:38:31.244012 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: User-Agent: python-urllib3/1.26.9 Jun 22 09:38:31.244012 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Auth-Token: gAAAAABisuI21lPLABRkHPR-UT_DC4HFBL-EPodoQd7JfJMsFWN6vZZPENcjlPwB1FVH4byq2ybqJvi0_p_FPQ0t7s_yXef8WsZeLIVs2OI_gJgxNf5dyvtc_cGxT54u1rrhjBGn-lPJdRkEWPetJ90qJGrUIpqs6XhTBOd_1Dwc8XxzkdDYYOY Jun 22 09:38:31.244012 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Id: None Jun 22 09:38:31.244012 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Name: None Jun 22 09:38:31.244012 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Identity-Status: Confirmed Jun 22 09:38:31.244012 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Is-Admin-Project: True Jun 22 09:38:31.244012 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Id: default Jun 22 09:38:31.244012 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Name: Default Jun 22 09:38:31.244012 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Id: 8c5252320d824d608d9ac574bf61dcc5 Jun 22 09:38:31.244012 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Name: tempest-TestMinimumBasicScenario-141221186 Jun 22 09:38:31.244012 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Role: member,reader Jun 22 09:38:31.244012 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Roles: member,reader Jun 22 09:38:31.249113 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8c5252320d824d608d9ac574bf61dcc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8c5252320d824d608d9ac574bf61dcc5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8c5252320d824d608d9ac574bf61dcc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8c5252320d824d608d9ac574bf61dcc5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:38:31.249113 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant: tempest-TestMinimumBasicScenario-141221186 Jun 22 09:38:31.249113 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Id: 8c5252320d824d608d9ac574bf61dcc5 Jun 22 09:38:31.249113 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Name: tempest-TestMinimumBasicScenario-141221186 Jun 22 09:38:31.249113 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User: tempest-TestMinimumBasicScenario-141221186-project Jun 22 09:38:31.249113 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Id: default Jun 22 09:38:31.249113 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Name: Default Jun 22 09:38:31.249113 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Id: 8426e9386439471c89880a2ef9eee2fa Jun 22 09:38:31.249113 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Name: tempest-TestMinimumBasicScenario-141221186-project Jun 22 09:38:31.249113 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: method: > Jun 22 09:38:31.249113 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: exception: Instance 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 is not attached to volume 47f834bf-e2c4-4957-b55a-5197249ca8e3 Jun 22 09:38:31.249927 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: action_args: {'server_id': '3e8c5a28-f8ae-45eb-bbf9-b28ae208c285', 'id': '47f834bf-e2c4-4957-b55a-5197249ca8e3'} Jun 22 09:38:31.249927 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:38:31.249927 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:38:31.249927 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 22 09:38:31.249927 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 22 09:38:31.249927 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 09:38:31.249927 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 09:38:31.249927 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 22 09:38:31.249927 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 22 09:38:31.249927 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 47f834bf-e2c4-4957-b55a-5197249ca8e3. Jun 22 09:38:31.249927 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:38:31.249927 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:38:31.249927 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:38:31.249927 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:38:31.249927 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:38:31.249927 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:38:31.249927 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:38:31.249927 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:38:31.249927 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:38:31.251252 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:38:31.251252 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 22 09:38:31.251252 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 22 09:38:31.251252 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 is not attached to volume 47f834bf-e2c4-4957-b55a-5197249ca8e3 Jun 22 09:38:31.251252 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:38:31.251252 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:38:31.251252 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:38:31.251252 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:38:31.251252 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:38:31.251252 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:38:31.251252 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:38:31.251252 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:38:31.251252 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 is not attached to volume 47f834bf-e2c4-4957-b55a-5197249ca8e3 Jun 22 09:38:31.251252 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:38:31.251252 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-17cd7755-9e15-4899-8130-e0f0f49eba64 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Returning 404 to user: Instance 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 is not attached to volume 47f834bf-e2c4-4957-b55a-5197249ca8e3 {{(pid=118024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:38:31.252665 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-17cd7755-9e15-4899-8130-e0f0f49eba64 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285/os-volume_attachments/47f834bf-e2c4-4957-b55a-5197249ca8e3" status: 404 len: 154 microversion: 2.1 time: 0.114217 Jun 22 09:38:31.252665 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 940/1928] 10.222.0.16 () {58 vars in 1415 bytes} [Wed Jun 22 09:38:31 2022] DELETE /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285/os-volume_attachments/47f834bf-e2c4-4957-b55a-5197249ca8e3 => generated 154 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:38:32.594161 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-110c9640-535c-452c-92a1-69e08be8a054 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:38:32.594666 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-110c9640-535c-452c-92a1-69e08be8a054 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:38:32.601349 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-110c9640-535c-452c-92a1-69e08be8a054 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:38:32.601796 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-110c9640-535c-452c-92a1-69e08be8a054 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:38:32.602586 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-110c9640-535c-452c-92a1-69e08be8a054 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:38:32.603021 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-110c9640-535c-452c-92a1-69e08be8a054 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:38:32.628456 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-110c9640-535c-452c-92a1-69e08be8a054 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Going to try to terminate instance {{(pid=118025) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:38:33.030776 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-110c9640-535c-452c-92a1-69e08be8a054 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 204 len: 0 microversion: 2.1 time: 0.440053 Jun 22 09:38:33.031329 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 989/1929] 10.222.0.16 () {58 vars in 1238 bytes} [Wed Jun 22 09:38:32 2022] DELETE /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:38:33.040387 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-42b3cbf7-916a-4aef-a288-d32d86cb9397 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:38:33.041025 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-42b3cbf7-916a-4aef-a288-d32d86cb9397 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:38:33.047546 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-42b3cbf7-916a-4aef-a288-d32d86cb9397 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:38:33.047993 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-42b3cbf7-916a-4aef-a288-d32d86cb9397 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:38:33.048921 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-42b3cbf7-916a-4aef-a288-d32d86cb9397 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:38:33.049545 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-42b3cbf7-916a-4aef-a288-d32d86cb9397 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:38:33.183247 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-42b3cbf7-916a-4aef-a288-d32d86cb9397 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:38:33.191006 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-42b3cbf7-916a-4aef-a288-d32d86cb9397 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1556 microversion: 2.1 time: 0.154470 Jun 22 09:38:33.200537 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 941/1930] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:38:33 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:38:34.208444 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d56da2d2-603f-48f8-b09b-ad889d851904 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:38:34.209174 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-d56da2d2-603f-48f8-b09b-ad889d851904 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:38:34.215796 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d56da2d2-603f-48f8-b09b-ad889d851904 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:38:34.216244 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d56da2d2-603f-48f8-b09b-ad889d851904 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:38:34.217049 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d56da2d2-603f-48f8-b09b-ad889d851904 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:38:34.217488 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-d56da2d2-603f-48f8-b09b-ad889d851904 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:38:34.612133 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-d56da2d2-603f-48f8-b09b-ad889d851904 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:38:34.618677 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d56da2d2-603f-48f8-b09b-ad889d851904 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1556 microversion: 2.1 time: 0.414836 Jun 22 09:38:34.619246 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 990/1931] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:38:34 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1556 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:38:35.635537 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-bd51e96a-b435-4211-b2bf-f54e4e6be93d tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:38:35.636219 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-bd51e96a-b435-4211-b2bf-f54e4e6be93d tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:38:35.642789 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bd51e96a-b435-4211-b2bf-f54e4e6be93d tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:38:35.647380 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bd51e96a-b435-4211-b2bf-f54e4e6be93d tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:38:35.647380 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bd51e96a-b435-4211-b2bf-f54e4e6be93d tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:38:35.647380 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-bd51e96a-b435-4211-b2bf-f54e4e6be93d tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:38:35.802517 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-bd51e96a-b435-4211-b2bf-f54e4e6be93d tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:38:35.821302 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-7f1414d8-4587-4d3e-9757-2c6a5ac27bb8 req-06dbd317-a432-4c02-aace-9d5c8b22cffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e8c5a28-f8ae-45eb-bbf9-b28ae208c285", "name": "network-vif-deleted", "tag": "bdb6db07-5143-42e2-bb43-ef3b56c62ba1"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:38:35.825758 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-bd51e96a-b435-4211-b2bf-f54e4e6be93d tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1556 microversion: 2.1 time: 0.194119 Jun 22 09:38:35.832819 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 942/1932] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:38:35 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1556 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:38:35.833016 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-7f1414d8-4587-4d3e-9757-2c6a5ac27bb8 req-06dbd317-a432-4c02-aace-9d5c8b22cffe service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:38:35.833016 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-7f1414d8-4587-4d3e-9757-2c6a5ac27bb8 req-06dbd317-a432-4c02-aace-9d5c8b22cffe service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:38:35.842500 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-7f1414d8-4587-4d3e-9757-2c6a5ac27bb8 req-06dbd317-a432-4c02-aace-9d5c8b22cffe service nova] Creating event network-vif-deleted:bdb6db07-5143-42e2-bb43-ef3b56c62ba1 for instance 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 on hv-cinder-84599 Jun 22 09:38:35.847548 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-7f1414d8-4587-4d3e-9757-2c6a5ac27bb8 req-06dbd317-a432-4c02-aace-9d5c8b22cffe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030419 Jun 22 09:38:35.848144 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 991/1933] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:38:36.845762 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-82156693-2ec2-4f50-b388-c5d8752061c9 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:38:36.847469 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-82156693-2ec2-4f50-b388-c5d8752061c9 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:38:36.854421 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-82156693-2ec2-4f50-b388-c5d8752061c9 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:38:36.857703 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-82156693-2ec2-4f50-b388-c5d8752061c9 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:38:36.857703 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-82156693-2ec2-4f50-b388-c5d8752061c9 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:38:36.857703 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-82156693-2ec2-4f50-b388-c5d8752061c9 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:38:36.889440 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-82156693-2ec2-4f50-b388-c5d8752061c9 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:38:36.889889 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-82156693-2ec2-4f50-b388-c5d8752061c9 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:38:36.890337 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.objects.instance [None req-82156693-2ec2-4f50-b388-c5d8752061c9 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lazy-loading 'fault' on Instance uuid 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 {{(pid=118024) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:38:36.932430 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-82156693-2ec2-4f50-b388-c5d8752061c9 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8426e9386439471c89880a2ef9eee2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5252320d824d608d9ac574bf61dcc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:38:36.939781 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-82156693-2ec2-4f50-b388-c5d8752061c9 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 200 len: 1349 microversion: 2.1 time: 0.097933 Jun 22 09:38:36.940358 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 943/1934] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:38:36 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 1349 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:38:37.958870 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-271ca4ec-45b8-442b-a5bd-a160e07dc59e tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:38:37.959601 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-271ca4ec-45b8-442b-a5bd-a160e07dc59e tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] [instance: 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:38:37.965952 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-271ca4ec-45b8-442b-a5bd-a160e07dc59e tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:38:37.966386 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-271ca4ec-45b8-442b-a5bd-a160e07dc59e tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:38:37.967148 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-271ca4ec-45b8-442b-a5bd-a160e07dc59e tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:38:37.967587 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-271ca4ec-45b8-442b-a5bd-a160e07dc59e tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:38:37.981206 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.wsgi [None req-271ca4ec-45b8-442b-a5bd-a160e07dc59e tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] HTTP exception thrown: Instance 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 could not be found. Jun 22 09:38:37.982855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-271ca4ec-45b8-442b-a5bd-a160e07dc59e tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Request method failure captured: Jun 22 09:38:37.982855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: request: GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 HTTP/1.1 Jun 22 09:38:37.982855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept: application/json Jun 22 09:38:37.982855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept-Encoding: identity Jun 22 09:38:37.982855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Connection: close Jun 22 09:38:37.982855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Length: 0 Jun 22 09:38:37.982855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Type: application/json Jun 22 09:38:37.982855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Host: 10.222.0.16 Jun 22 09:38:37.982855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Openstack-System-Scope: None Jun 22 09:38:37.982855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: User-Agent: python-urllib3/1.26.9 Jun 22 09:38:37.982855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Auth-Token: gAAAAABisuI21lPLABRkHPR-UT_DC4HFBL-EPodoQd7JfJMsFWN6vZZPENcjlPwB1FVH4byq2ybqJvi0_p_FPQ0t7s_yXef8WsZeLIVs2OI_gJgxNf5dyvtc_cGxT54u1rrhjBGn-lPJdRkEWPetJ90qJGrUIpqs6XhTBOd_1Dwc8XxzkdDYYOY Jun 22 09:38:37.982855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Id: None Jun 22 09:38:37.982855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Name: None Jun 22 09:38:37.982855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Identity-Status: Confirmed Jun 22 09:38:37.982855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Is-Admin-Project: True Jun 22 09:38:37.982855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Id: default Jun 22 09:38:37.982855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Name: Default Jun 22 09:38:37.982855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Id: 8c5252320d824d608d9ac574bf61dcc5 Jun 22 09:38:37.982855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Name: tempest-TestMinimumBasicScenario-141221186 Jun 22 09:38:37.982855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Role: member,reader Jun 22 09:38:37.982855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Roles: member,reader Jun 22 09:38:37.984444 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8c5252320d824d608d9ac574bf61dcc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8c5252320d824d608d9ac574bf61dcc5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8c5252320d824d608d9ac574bf61dcc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8c5252320d824d608d9ac574bf61dcc5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:38:37.984444 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant: tempest-TestMinimumBasicScenario-141221186 Jun 22 09:38:37.984444 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Id: 8c5252320d824d608d9ac574bf61dcc5 Jun 22 09:38:37.984444 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Name: tempest-TestMinimumBasicScenario-141221186 Jun 22 09:38:37.984444 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User: tempest-TestMinimumBasicScenario-141221186-project Jun 22 09:38:37.984444 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Id: default Jun 22 09:38:37.984444 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Name: Default Jun 22 09:38:37.984444 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Id: 8426e9386439471c89880a2ef9eee2fa Jun 22 09:38:37.984444 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Name: tempest-TestMinimumBasicScenario-141221186-project Jun 22 09:38:37.984444 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: method: > Jun 22 09:38:37.984444 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: exception: Instance 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 could not be found. Jun 22 09:38:37.984444 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: action_args: {'id': '3e8c5a28-f8ae-45eb-bbf9-b28ae208c285'} Jun 22 09:38:37.985352 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:38:37.985352 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:38:37.985352 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:38:37.985352 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:38:37.985352 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:38:37.985352 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:38:37.985352 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:38:37.985352 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:38:37.985352 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:38:37.985352 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:38:37.985352 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 could not be found. Jun 22 09:38:37.985352 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:38:37.985352 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:38:37.985352 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:38:37.985352 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:38:37.985352 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:38:37.985352 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:38:37.985352 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:38:37.985352 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:38:37.985352 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:38:37.986747 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:38:37.986747 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:38:37.986747 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:38:37.986747 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:38:37.986747 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:38:37.986747 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:38:37.986747 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:38:37.986747 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 could not be found. Jun 22 09:38:37.986747 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:38:37.986747 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:38:37.986747 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:38:37.986747 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:38:37.986747 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:38:37.986747 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:38:37.986747 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:38:37.986747 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:38:37.986747 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 could not be found. Jun 22 09:38:37.986747 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:38:37.988569 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-271ca4ec-45b8-442b-a5bd-a160e07dc59e tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Returning 404 to user: Instance 3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 could not be found. {{(pid=118025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:38:37.988569 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-271ca4ec-45b8-442b-a5bd-a160e07dc59e tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285" status: 404 len: 111 microversion: 2.1 time: 0.030454 Jun 22 09:38:37.988569 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 992/1935] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:38:37 2022] GET /compute/v2.1/servers/3e8c5a28-f8ae-45eb-bbf9-b28ae208c285 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:38:37.994033 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-dc9998c1-bc1b-48d9-9823-714866b45133 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] Calling method '.version_select at 0x7f575608b160>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:38:38.068667 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-dc9998c1-bc1b-48d9-9823-714866b45133 tempest-TestMinimumBasicScenario-141221186 tempest-TestMinimumBasicScenario-141221186-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1287086065" status: 202 len: 0 microversion: 2.1 time: 0.078328 Jun 22 09:38:38.069399 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 944/1936] 10.222.0.16 () {58 vars in 1271 bytes} [Wed Jun 22 09:38:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1287086065 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:39:53.127023 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:39:53.127778 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:39:53.131802 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-babefdb4-39ac-4621-93ee-0e00af041a0e tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:39:53.132398 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-babefdb4-39ac-4621-93ee-0e00af041a0e tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:39:53.138713 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-babefdb4-39ac-4621-93ee-0e00af041a0e tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:39:53.139166 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-babefdb4-39ac-4621-93ee-0e00af041a0e tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:39:53.140105 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-babefdb4-39ac-4621-93ee-0e00af041a0e tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:39:53.140546 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-babefdb4-39ac-4621-93ee-0e00af041a0e tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:39:53.165454 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.objects.instance [None req-babefdb4-39ac-4621-93ee-0e00af041a0e tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lazy-loading 'flavor' on Instance uuid 7dce7006-cd1a-47c6-8277-069dd009e5e6 {{(pid=118025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:39:53.336382 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:39:53.336663 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Wed Jun 22 09:39:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6/action (ip 10.222.0.16) !!! Jun 22 09:39:53.486612 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-babefdb4-39ac-4621-93ee-0e00af041a0e tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "POST /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6/action" status: 202 len: 0 microversion: 2.1 time: 0.361320 Jun 22 09:39:53.487113 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 993/1937] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jun 22 09:39:53 2022] POST /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:39:53.493527 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=40 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:39:53.494391 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:39:53.499021 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3699730e-0a68-412f-b014-ef33afd454c4 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:39:53.499666 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3699730e-0a68-412f-b014-ef33afd454c4 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:39:53.506106 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3699730e-0a68-412f-b014-ef33afd454c4 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:39:53.506551 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3699730e-0a68-412f-b014-ef33afd454c4 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:39:53.507308 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3699730e-0a68-412f-b014-ef33afd454c4 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:39:53.507745 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3699730e-0a68-412f-b014-ef33afd454c4 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:39:53.797458 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3699730e-0a68-412f-b014-ef33afd454c4 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:39:53.805058 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3699730e-0a68-412f-b014-ef33afd454c4 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1567 microversion: 2.1 time: 0.313555 Jun 22 09:39:53.805615 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 945/1938] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:39:53 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1567 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:39:54.823728 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-1517e6ef-e913-4b2b-8b4d-5cadd6ec55a4 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:39:54.824430 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-1517e6ef-e913-4b2b-8b4d-5cadd6ec55a4 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:39:54.830759 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1517e6ef-e913-4b2b-8b4d-5cadd6ec55a4 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:39:54.831210 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1517e6ef-e913-4b2b-8b4d-5cadd6ec55a4 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:39:54.831969 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1517e6ef-e913-4b2b-8b4d-5cadd6ec55a4 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:39:54.832411 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1517e6ef-e913-4b2b-8b4d-5cadd6ec55a4 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:39:54.966858 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-1517e6ef-e913-4b2b-8b4d-5cadd6ec55a4 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:39:54.975059 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-1517e6ef-e913-4b2b-8b4d-5cadd6ec55a4 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1567 microversion: 2.1 time: 0.156152 Jun 22 09:39:54.975612 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 994/1939] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:39:54 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:39:55.992276 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-2beb5379-7845-4491-a373-5e391a92ab8f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:39:55.992961 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-2beb5379-7845-4491-a373-5e391a92ab8f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:39:55.999706 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2beb5379-7845-4491-a373-5e391a92ab8f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:39:56.000898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2beb5379-7845-4491-a373-5e391a92ab8f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:39:56.001802 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2beb5379-7845-4491-a373-5e391a92ab8f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:39:56.002246 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2beb5379-7845-4491-a373-5e391a92ab8f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:39:56.142465 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-2beb5379-7845-4491-a373-5e391a92ab8f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:39:56.151676 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-2beb5379-7845-4491-a373-5e391a92ab8f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1567 microversion: 2.1 time: 0.163357 Jun 22 09:39:56.152270 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 946/1940] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:39:55 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:39:57.160421 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:39:57.161160 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Wed Jun 22 09:39:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:39:57.173721 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-435cb719-963e-46fe-9ea2-b7cc530bd6db tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:39:57.174375 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-435cb719-963e-46fe-9ea2-b7cc530bd6db tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:39:57.181310 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-435cb719-963e-46fe-9ea2-b7cc530bd6db tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:39:57.181755 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-435cb719-963e-46fe-9ea2-b7cc530bd6db tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:39:57.182525 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-435cb719-963e-46fe-9ea2-b7cc530bd6db tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:39:57.182961 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-435cb719-963e-46fe-9ea2-b7cc530bd6db tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:39:57.346537 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-435cb719-963e-46fe-9ea2-b7cc530bd6db tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:39:57.355366 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-435cb719-963e-46fe-9ea2-b7cc530bd6db tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1567 microversion: 2.1 time: 0.187767 Jun 22 09:39:57.355943 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 995/1941] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:39:57 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:39:58.373282 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-8696ff3b-6e4e-435d-90c2-bfb56e219c24 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:39:58.373981 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-8696ff3b-6e4e-435d-90c2-bfb56e219c24 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:39:58.382752 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8696ff3b-6e4e-435d-90c2-bfb56e219c24 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:39:58.383194 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8696ff3b-6e4e-435d-90c2-bfb56e219c24 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:39:58.384216 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8696ff3b-6e4e-435d-90c2-bfb56e219c24 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:39:58.384655 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-8696ff3b-6e4e-435d-90c2-bfb56e219c24 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:39:58.537751 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-8696ff3b-6e4e-435d-90c2-bfb56e219c24 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:39:58.545242 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-8696ff3b-6e4e-435d-90c2-bfb56e219c24 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1567 microversion: 2.1 time: 0.175789 Jun 22 09:39:58.545788 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 947/1942] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:39:58 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:39:59.242276 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:39:59.242825 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Wed Jun 22 09:39:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:39:59.563781 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e9252fed-3e41-429b-ac53-343760da6ddb tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:39:59.564734 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e9252fed-3e41-429b-ac53-343760da6ddb tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:39:59.574905 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e9252fed-3e41-429b-ac53-343760da6ddb tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:39:59.575682 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e9252fed-3e41-429b-ac53-343760da6ddb tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:39:59.576922 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e9252fed-3e41-429b-ac53-343760da6ddb tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:39:59.577567 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e9252fed-3e41-429b-ac53-343760da6ddb tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:39:59.734662 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-e9252fed-3e41-429b-ac53-343760da6ddb tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:39:59.742704 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e9252fed-3e41-429b-ac53-343760da6ddb tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1567 microversion: 2.1 time: 0.183757 Jun 22 09:39:59.743283 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 996/1943] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:39:59 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:40:00.761109 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-68f64dc7-b167-4ff2-82e1-c93cba803ed6 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:40:00.761746 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-68f64dc7-b167-4ff2-82e1-c93cba803ed6 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:40:00.768314 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-68f64dc7-b167-4ff2-82e1-c93cba803ed6 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:00.768768 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-68f64dc7-b167-4ff2-82e1-c93cba803ed6 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:00.769590 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-68f64dc7-b167-4ff2-82e1-c93cba803ed6 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:00.770038 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-68f64dc7-b167-4ff2-82e1-c93cba803ed6 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:00.931694 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-68f64dc7-b167-4ff2-82e1-c93cba803ed6 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:40:00.940696 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-68f64dc7-b167-4ff2-82e1-c93cba803ed6 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1567 microversion: 2.1 time: 0.183799 Jun 22 09:40:00.941303 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 948/1944] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:40:00 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:40:01.960089 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-f730ad78-fc9d-41d8-afa0-b06ed795f00f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:40:01.960647 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-f730ad78-fc9d-41d8-afa0-b06ed795f00f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:40:01.968855 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f730ad78-fc9d-41d8-afa0-b06ed795f00f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:01.970114 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f730ad78-fc9d-41d8-afa0-b06ed795f00f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:01.971127 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f730ad78-fc9d-41d8-afa0-b06ed795f00f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:01.971908 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-f730ad78-fc9d-41d8-afa0-b06ed795f00f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:02.133618 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-f730ad78-fc9d-41d8-afa0-b06ed795f00f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:40:02.144906 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-f730ad78-fc9d-41d8-afa0-b06ed795f00f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1567 microversion: 2.1 time: 0.189492 Jun 22 09:40:02.145493 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 997/1945] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:40:01 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:40:02.815283 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-2edd6e95-1912-40bd-b00f-5f2d820b8843 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:40:02.815874 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-2edd6e95-1912-40bd-b00f-5f2d820b8843 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: f5dbd1b0-e21e-46fd-818b-da300c8cf1e7] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:40:02.822301 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2edd6e95-1912-40bd-b00f-5f2d820b8843 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:02.822743 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2edd6e95-1912-40bd-b00f-5f2d820b8843 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:02.823507 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2edd6e95-1912-40bd-b00f-5f2d820b8843 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:02.823937 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-2edd6e95-1912-40bd-b00f-5f2d820b8843 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:02.838723 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.wsgi [None req-2edd6e95-1912-40bd-b00f-5f2d820b8843 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] HTTP exception thrown: Instance f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 could not be found. Jun 22 09:40:02.840289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-2edd6e95-1912-40bd-b00f-5f2d820b8843 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Request method failure captured: Jun 22 09:40:02.840289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: request: DELETE /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 HTTP/1.1 Jun 22 09:40:02.840289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept: application/json Jun 22 09:40:02.840289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept-Encoding: identity Jun 22 09:40:02.840289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Connection: close Jun 22 09:40:02.840289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Length: 0 Jun 22 09:40:02.840289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Type: application/json Jun 22 09:40:02.840289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Host: 10.222.0.16 Jun 22 09:40:02.840289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Openstack-System-Scope: None Jun 22 09:40:02.840289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: User-Agent: python-urllib3/1.26.9 Jun 22 09:40:02.840289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Auth-Token: gAAAAABistmqD47tOpCEfZxXQ7v8d4kDBzbZcFIWDuyhnuGnU13mxMlhbgt18xo2M0HJq-gXeYBWo0pfkDLuGB3yaG8TUwjVHhSVzhHn4vsUiwL4uQjCeCtk_V7_A6rYsksudlP-79icDu6EqbcTRNIwpnAGEp7HhBlOtNGTaFEH_UUlynGlRmI Jun 22 09:40:02.840289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Id: None Jun 22 09:40:02.840289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Name: None Jun 22 09:40:02.840289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Identity-Status: Confirmed Jun 22 09:40:02.840289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Is-Admin-Project: True Jun 22 09:40:02.840289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Id: default Jun 22 09:40:02.840289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Name: Default Jun 22 09:40:02.840289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Id: 9ebdcb9809a84f25bd578f8aca09802c Jun 22 09:40:02.840289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Name: tempest-AttachVolumeNegativeTest-914919780 Jun 22 09:40:02.840289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Role: member,reader Jun 22 09:40:02.840289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Roles: member,reader Jun 22 09:40:02.841850 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebdcb9809a84f25bd578f8aca09802c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebdcb9809a84f25bd578f8aca09802c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ebdcb9809a84f25bd578f8aca09802c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ebdcb9809a84f25bd578f8aca09802c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:40:02.841850 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant: tempest-AttachVolumeNegativeTest-914919780 Jun 22 09:40:02.841850 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Id: 9ebdcb9809a84f25bd578f8aca09802c Jun 22 09:40:02.841850 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-914919780 Jun 22 09:40:02.841850 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User: tempest-AttachVolumeNegativeTest-914919780-project Jun 22 09:40:02.841850 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Id: default Jun 22 09:40:02.841850 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Name: Default Jun 22 09:40:02.841850 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Id: 71ea2610ccc044de9d66444b4038fe9e Jun 22 09:40:02.841850 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Name: tempest-AttachVolumeNegativeTest-914919780-project Jun 22 09:40:02.841850 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: method: > Jun 22 09:40:02.841850 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: exception: Instance f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 could not be found. Jun 22 09:40:02.841850 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: action_args: {'id': 'f5dbd1b0-e21e-46fd-818b-da300c8cf1e7'} Jun 22 09:40:02.842806 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:40:02.842806 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:02.842806 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:40:02.842806 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:40:02.842806 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:40:02.842806 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:40:02.842806 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:40:02.842806 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:40:02.842806 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:40:02.842806 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:40:02.842806 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 could not be found. Jun 22 09:40:02.842806 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:02.842806 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:40:02.842806 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:02.842806 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:02.842806 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:40:02.842806 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:40:02.842806 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:40:02.842806 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:40:02.842806 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:40:02.844441 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:40:02.844441 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 09:40:02.844441 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 09:40:02.844441 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 09:40:02.844441 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 09:40:02.844441 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:40:02.844441 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:40:02.844441 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:40:02.844441 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:40:02.844441 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 could not be found. Jun 22 09:40:02.844441 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:02.844441 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:40:02.844441 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:02.844441 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:02.844441 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:40:02.844441 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:40:02.844441 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:40:02.844441 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:40:02.844441 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 could not be found. Jun 22 09:40:02.844441 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:02.846195 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-2edd6e95-1912-40bd-b00f-5f2d820b8843 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Returning 404 to user: Instance f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 could not be found. {{(pid=118024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:40:02.846195 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-2edd6e95-1912-40bd-b00f-5f2d820b8843 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7" status: 404 len: 111 microversion: 2.1 time: 0.030383 Jun 22 09:40:02.846195 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 949/1946] 10.222.0.16 () {58 vars in 1238 bytes} [Wed Jun 22 09:40:02 2022] DELETE /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:40:02.852553 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-8ddbe421-cb25-4829-9083-02ba4cf9dc3e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:40:02.853273 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-8ddbe421-cb25-4829-9083-02ba4cf9dc3e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: f5dbd1b0-e21e-46fd-818b-da300c8cf1e7] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:40:02.861434 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8ddbe421-cb25-4829-9083-02ba4cf9dc3e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:02.861963 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8ddbe421-cb25-4829-9083-02ba4cf9dc3e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:02.862838 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8ddbe421-cb25-4829-9083-02ba4cf9dc3e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:02.863315 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-8ddbe421-cb25-4829-9083-02ba4cf9dc3e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:02.881761 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.wsgi [None req-8ddbe421-cb25-4829-9083-02ba4cf9dc3e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] HTTP exception thrown: Instance f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 could not be found. Jun 22 09:40:02.881761 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-8ddbe421-cb25-4829-9083-02ba4cf9dc3e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Request method failure captured: Jun 22 09:40:02.881761 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: request: GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 HTTP/1.1 Jun 22 09:40:02.881761 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept: application/json Jun 22 09:40:02.881761 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept-Encoding: identity Jun 22 09:40:02.881761 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Connection: close Jun 22 09:40:02.881761 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Length: 0 Jun 22 09:40:02.881761 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Type: application/json Jun 22 09:40:02.881761 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Host: 10.222.0.16 Jun 22 09:40:02.881761 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Openstack-System-Scope: None Jun 22 09:40:02.881761 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: User-Agent: python-urllib3/1.26.9 Jun 22 09:40:02.881761 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Auth-Token: gAAAAABistmqD47tOpCEfZxXQ7v8d4kDBzbZcFIWDuyhnuGnU13mxMlhbgt18xo2M0HJq-gXeYBWo0pfkDLuGB3yaG8TUwjVHhSVzhHn4vsUiwL4uQjCeCtk_V7_A6rYsksudlP-79icDu6EqbcTRNIwpnAGEp7HhBlOtNGTaFEH_UUlynGlRmI Jun 22 09:40:02.881761 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Id: None Jun 22 09:40:02.881761 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Name: None Jun 22 09:40:02.881761 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Identity-Status: Confirmed Jun 22 09:40:02.881761 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Is-Admin-Project: True Jun 22 09:40:02.881761 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Id: default Jun 22 09:40:02.881761 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Name: Default Jun 22 09:40:02.881761 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Id: 9ebdcb9809a84f25bd578f8aca09802c Jun 22 09:40:02.881761 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Name: tempest-AttachVolumeNegativeTest-914919780 Jun 22 09:40:02.881761 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Role: member,reader Jun 22 09:40:02.881761 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Roles: member,reader Jun 22 09:40:02.883178 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebdcb9809a84f25bd578f8aca09802c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebdcb9809a84f25bd578f8aca09802c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ebdcb9809a84f25bd578f8aca09802c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ebdcb9809a84f25bd578f8aca09802c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:40:02.883178 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant: tempest-AttachVolumeNegativeTest-914919780 Jun 22 09:40:02.883178 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Id: 9ebdcb9809a84f25bd578f8aca09802c Jun 22 09:40:02.883178 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-914919780 Jun 22 09:40:02.883178 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User: tempest-AttachVolumeNegativeTest-914919780-project Jun 22 09:40:02.883178 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Id: default Jun 22 09:40:02.883178 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Name: Default Jun 22 09:40:02.883178 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Id: 71ea2610ccc044de9d66444b4038fe9e Jun 22 09:40:02.883178 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Name: tempest-AttachVolumeNegativeTest-914919780-project Jun 22 09:40:02.883178 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: method: > Jun 22 09:40:02.883178 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: exception: Instance f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 could not be found. Jun 22 09:40:02.883178 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: action_args: {'id': 'f5dbd1b0-e21e-46fd-818b-da300c8cf1e7'} Jun 22 09:40:02.883886 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:40:02.883886 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:02.883886 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:40:02.883886 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:40:02.883886 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:40:02.883886 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:40:02.883886 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:40:02.883886 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:40:02.883886 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:40:02.883886 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:40:02.883886 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 could not be found. Jun 22 09:40:02.883886 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:02.883886 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:40:02.883886 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:02.883886 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:02.883886 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:40:02.883886 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:40:02.883886 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:40:02.883886 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:40:02.883886 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:40:02.885006 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:40:02.885006 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:40:02.885006 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:40:02.885006 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:40:02.885006 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:40:02.885006 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:40:02.885006 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:40:02.885006 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 could not be found. Jun 22 09:40:02.885006 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:02.885006 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:40:02.885006 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:02.885006 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:02.885006 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:40:02.885006 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:40:02.885006 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:40:02.885006 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:40:02.885006 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 could not be found. Jun 22 09:40:02.885006 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:02.885971 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-8ddbe421-cb25-4829-9083-02ba4cf9dc3e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Returning 404 to user: Instance f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 could not be found. {{(pid=118025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:40:02.885971 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-8ddbe421-cb25-4829-9083-02ba4cf9dc3e tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7" status: 404 len: 111 microversion: 2.1 time: 0.033047 Jun 22 09:40:02.885971 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 998/1947] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:40:02 2022] GET /compute/v2.1/servers/f5dbd1b0-e21e-46fd-818b-da300c8cf1e7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:40:03.161775 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-4e900673-b118-4bb7-9fb1-aad5cef2a0d9 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:40:03.162306 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-4e900673-b118-4bb7-9fb1-aad5cef2a0d9 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:40:03.168857 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4e900673-b118-4bb7-9fb1-aad5cef2a0d9 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:03.169335 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4e900673-b118-4bb7-9fb1-aad5cef2a0d9 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:03.170100 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4e900673-b118-4bb7-9fb1-aad5cef2a0d9 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:03.170543 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-4e900673-b118-4bb7-9fb1-aad5cef2a0d9 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:03.312564 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-4e900673-b118-4bb7-9fb1-aad5cef2a0d9 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:40:03.326378 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-4e900673-b118-4bb7-9fb1-aad5cef2a0d9 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1567 microversion: 2.1 time: 0.168179 Jun 22 09:40:03.327532 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 950/1948] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:40:03 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:40:04.163898 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-73c9593d-94ad-45f9-8eb3-706156100f9b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:40:04.164463 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-73c9593d-94ad-45f9-8eb3-706156100f9b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:40:04.171059 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-73c9593d-94ad-45f9-8eb3-706156100f9b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:04.171510 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-73c9593d-94ad-45f9-8eb3-706156100f9b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:04.172326 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-73c9593d-94ad-45f9-8eb3-706156100f9b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:04.172763 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-73c9593d-94ad-45f9-8eb3-706156100f9b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:04.188397 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.wsgi [None req-73c9593d-94ad-45f9-8eb3-706156100f9b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] HTTP exception thrown: Instance cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 could not be found. Jun 22 09:40:04.190111 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-73c9593d-94ad-45f9-8eb3-706156100f9b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Request method failure captured: Jun 22 09:40:04.190111 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: request: DELETE /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 HTTP/1.1 Jun 22 09:40:04.190111 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept: application/json Jun 22 09:40:04.190111 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept-Encoding: identity Jun 22 09:40:04.190111 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Connection: close Jun 22 09:40:04.190111 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Length: 0 Jun 22 09:40:04.190111 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Type: application/json Jun 22 09:40:04.190111 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Host: 10.222.0.16 Jun 22 09:40:04.190111 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Openstack-System-Scope: None Jun 22 09:40:04.190111 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: User-Agent: python-urllib3/1.26.9 Jun 22 09:40:04.190111 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Auth-Token: gAAAAABistmqD47tOpCEfZxXQ7v8d4kDBzbZcFIWDuyhnuGnU13mxMlhbgt18xo2M0HJq-gXeYBWo0pfkDLuGB3yaG8TUwjVHhSVzhHn4vsUiwL4uQjCeCtk_V7_A6rYsksudlP-79icDu6EqbcTRNIwpnAGEp7HhBlOtNGTaFEH_UUlynGlRmI Jun 22 09:40:04.190111 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Id: None Jun 22 09:40:04.190111 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Name: None Jun 22 09:40:04.190111 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Identity-Status: Confirmed Jun 22 09:40:04.190111 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Is-Admin-Project: True Jun 22 09:40:04.190111 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Id: default Jun 22 09:40:04.190111 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Name: Default Jun 22 09:40:04.190111 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Id: 9ebdcb9809a84f25bd578f8aca09802c Jun 22 09:40:04.190111 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Name: tempest-AttachVolumeNegativeTest-914919780 Jun 22 09:40:04.190111 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Role: member,reader Jun 22 09:40:04.190111 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Roles: member,reader Jun 22 09:40:04.191311 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebdcb9809a84f25bd578f8aca09802c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebdcb9809a84f25bd578f8aca09802c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ebdcb9809a84f25bd578f8aca09802c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ebdcb9809a84f25bd578f8aca09802c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:40:04.191311 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant: tempest-AttachVolumeNegativeTest-914919780 Jun 22 09:40:04.191311 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Id: 9ebdcb9809a84f25bd578f8aca09802c Jun 22 09:40:04.191311 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-914919780 Jun 22 09:40:04.191311 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User: tempest-AttachVolumeNegativeTest-914919780-project Jun 22 09:40:04.191311 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Id: default Jun 22 09:40:04.191311 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Name: Default Jun 22 09:40:04.191311 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Id: 71ea2610ccc044de9d66444b4038fe9e Jun 22 09:40:04.191311 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Name: tempest-AttachVolumeNegativeTest-914919780-project Jun 22 09:40:04.191311 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: method: > Jun 22 09:40:04.191311 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: exception: Instance cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 could not be found. Jun 22 09:40:04.191311 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: action_args: {'id': 'cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10'} Jun 22 09:40:04.191975 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:40:04.191975 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:04.191975 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:40:04.191975 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:40:04.191975 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:40:04.191975 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:40:04.191975 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:40:04.191975 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:40:04.191975 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:40:04.191975 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:40:04.191975 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 could not be found. Jun 22 09:40:04.191975 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:04.191975 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:40:04.191975 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:04.191975 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:04.191975 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:40:04.191975 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:40:04.191975 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:40:04.191975 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:40:04.191975 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:40:04.193143 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:40:04.193143 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 09:40:04.193143 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 09:40:04.193143 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 09:40:04.193143 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 09:40:04.193143 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:40:04.193143 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:40:04.193143 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:40:04.193143 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:40:04.193143 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 could not be found. Jun 22 09:40:04.193143 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:04.193143 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:40:04.193143 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:04.193143 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:04.193143 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:40:04.193143 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:40:04.193143 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:40:04.193143 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:40:04.193143 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 could not be found. Jun 22 09:40:04.193143 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:04.194686 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-73c9593d-94ad-45f9-8eb3-706156100f9b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Returning 404 to user: Instance cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 could not be found. {{(pid=118025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:40:04.194686 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-73c9593d-94ad-45f9-8eb3-706156100f9b tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 404 len: 111 microversion: 2.1 time: 0.031533 Jun 22 09:40:04.194686 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 999/1949] 10.222.0.16 () {58 vars in 1238 bytes} [Wed Jun 22 09:40:04 2022] DELETE /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:40:04.202328 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1002c485-c6a8-42b0-a1c7-bc4169c0b667 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:40:04.203295 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1002c485-c6a8-42b0-a1c7-bc4169c0b667 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] [instance: cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:40:04.211107 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1002c485-c6a8-42b0-a1c7-bc4169c0b667 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:04.211559 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1002c485-c6a8-42b0-a1c7-bc4169c0b667 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:04.212343 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1002c485-c6a8-42b0-a1c7-bc4169c0b667 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:04.212811 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1002c485-c6a8-42b0-a1c7-bc4169c0b667 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:04.230829 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.wsgi [None req-1002c485-c6a8-42b0-a1c7-bc4169c0b667 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] HTTP exception thrown: Instance cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 could not be found. Jun 22 09:40:04.232389 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1002c485-c6a8-42b0-a1c7-bc4169c0b667 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Request method failure captured: Jun 22 09:40:04.232389 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: request: GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 HTTP/1.1 Jun 22 09:40:04.232389 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept: application/json Jun 22 09:40:04.232389 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept-Encoding: identity Jun 22 09:40:04.232389 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Connection: close Jun 22 09:40:04.232389 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Length: 0 Jun 22 09:40:04.232389 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Type: application/json Jun 22 09:40:04.232389 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Host: 10.222.0.16 Jun 22 09:40:04.232389 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Openstack-System-Scope: None Jun 22 09:40:04.232389 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: User-Agent: python-urllib3/1.26.9 Jun 22 09:40:04.232389 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Auth-Token: gAAAAABistmqD47tOpCEfZxXQ7v8d4kDBzbZcFIWDuyhnuGnU13mxMlhbgt18xo2M0HJq-gXeYBWo0pfkDLuGB3yaG8TUwjVHhSVzhHn4vsUiwL4uQjCeCtk_V7_A6rYsksudlP-79icDu6EqbcTRNIwpnAGEp7HhBlOtNGTaFEH_UUlynGlRmI Jun 22 09:40:04.232389 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Id: None Jun 22 09:40:04.232389 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Name: None Jun 22 09:40:04.232389 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Identity-Status: Confirmed Jun 22 09:40:04.232389 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Is-Admin-Project: True Jun 22 09:40:04.232389 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Id: default Jun 22 09:40:04.232389 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Name: Default Jun 22 09:40:04.232389 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Id: 9ebdcb9809a84f25bd578f8aca09802c Jun 22 09:40:04.232389 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Name: tempest-AttachVolumeNegativeTest-914919780 Jun 22 09:40:04.232389 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Role: member,reader Jun 22 09:40:04.232389 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Roles: member,reader Jun 22 09:40:04.234225 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebdcb9809a84f25bd578f8aca09802c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebdcb9809a84f25bd578f8aca09802c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ebdcb9809a84f25bd578f8aca09802c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ebdcb9809a84f25bd578f8aca09802c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:40:04.234225 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant: tempest-AttachVolumeNegativeTest-914919780 Jun 22 09:40:04.234225 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Id: 9ebdcb9809a84f25bd578f8aca09802c Jun 22 09:40:04.234225 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-914919780 Jun 22 09:40:04.234225 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User: tempest-AttachVolumeNegativeTest-914919780-project Jun 22 09:40:04.234225 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Id: default Jun 22 09:40:04.234225 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Name: Default Jun 22 09:40:04.234225 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Id: 71ea2610ccc044de9d66444b4038fe9e Jun 22 09:40:04.234225 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Name: tempest-AttachVolumeNegativeTest-914919780-project Jun 22 09:40:04.234225 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: method: > Jun 22 09:40:04.234225 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: exception: Instance cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 could not be found. Jun 22 09:40:04.234225 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: action_args: {'id': 'cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10'} Jun 22 09:40:04.235398 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:40:04.235398 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:04.235398 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:40:04.235398 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:40:04.235398 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:40:04.235398 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:40:04.235398 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:40:04.235398 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:40:04.235398 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:40:04.235398 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:40:04.235398 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 could not be found. Jun 22 09:40:04.235398 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:04.235398 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:40:04.235398 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:04.235398 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:04.235398 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:40:04.235398 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:40:04.235398 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:40:04.235398 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:40:04.235398 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:40:04.238648 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:40:04.238648 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:40:04.238648 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:40:04.238648 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:40:04.238648 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:40:04.238648 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:40:04.238648 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:40:04.238648 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 could not be found. Jun 22 09:40:04.238648 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:04.238648 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:40:04.238648 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:04.238648 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:04.238648 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:40:04.238648 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:40:04.238648 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:40:04.238648 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:40:04.238648 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 could not be found. Jun 22 09:40:04.238648 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:04.239855 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1002c485-c6a8-42b0-a1c7-bc4169c0b667 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] Returning 404 to user: Instance cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 could not be found. {{(pid=118024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:40:04.239855 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1002c485-c6a8-42b0-a1c7-bc4169c0b667 tempest-AttachVolumeNegativeTest-914919780 tempest-AttachVolumeNegativeTest-914919780-project] 10.222.0.16 "GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10" status: 404 len: 111 microversion: 2.1 time: 0.037311 Jun 22 09:40:04.239855 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 951/1950] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:40:04 2022] GET /compute/v2.1/servers/cd7a26e7-c5a5-4d06-ae2f-b70bcdd94c10 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:40:04.351511 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-1472b3a8-bbe2-4dfb-b995-45eac6fd78ab tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:40:04.352131 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-1472b3a8-bbe2-4dfb-b995-45eac6fd78ab tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:40:04.358735 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1472b3a8-bbe2-4dfb-b995-45eac6fd78ab tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:04.359219 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1472b3a8-bbe2-4dfb-b995-45eac6fd78ab tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:04.360430 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1472b3a8-bbe2-4dfb-b995-45eac6fd78ab tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:04.360849 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-1472b3a8-bbe2-4dfb-b995-45eac6fd78ab tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:04.614541 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-1472b3a8-bbe2-4dfb-b995-45eac6fd78ab tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:40:04.622421 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-1472b3a8-bbe2-4dfb-b995-45eac6fd78ab tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1567 microversion: 2.1 time: 0.274950 Jun 22 09:40:04.623066 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 1000/1951] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:40:04 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1567 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:40:05.639684 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1df44513-0541-47e2-84dc-21fe347acfb0 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:40:05.640290 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1df44513-0541-47e2-84dc-21fe347acfb0 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:40:05.647380 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1df44513-0541-47e2-84dc-21fe347acfb0 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:05.647839 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1df44513-0541-47e2-84dc-21fe347acfb0 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:05.648625 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1df44513-0541-47e2-84dc-21fe347acfb0 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:05.649093 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1df44513-0541-47e2-84dc-21fe347acfb0 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:05.894989 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-1df44513-0541-47e2-84dc-21fe347acfb0 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:40:05.905704 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1df44513-0541-47e2-84dc-21fe347acfb0 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1567 microversion: 2.1 time: 0.269768 Jun 22 09:40:05.906476 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 952/1952] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:40:05 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1567 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:40:06.929507 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-4ffdf2d9-9568-4de9-b75a-d17e6032d36a tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:40:06.929507 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-4ffdf2d9-9568-4de9-b75a-d17e6032d36a tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:40:06.934410 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4ffdf2d9-9568-4de9-b75a-d17e6032d36a tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:06.934946 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4ffdf2d9-9568-4de9-b75a-d17e6032d36a tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:06.935864 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4ffdf2d9-9568-4de9-b75a-d17e6032d36a tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:06.936374 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-4ffdf2d9-9568-4de9-b75a-d17e6032d36a tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:07.441383 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-4ffdf2d9-9568-4de9-b75a-d17e6032d36a tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:40:07.449487 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-4ffdf2d9-9568-4de9-b75a-d17e6032d36a tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1567 microversion: 2.1 time: 0.528749 Jun 22 09:40:07.450235 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 1001/1953] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:40:06 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1567 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:40:08.473456 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-9ee01dbc-4fe9-4d26-8c88-4ca94149a528 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:40:08.477927 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-9ee01dbc-4fe9-4d26-8c88-4ca94149a528 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:40:08.483620 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9ee01dbc-4fe9-4d26-8c88-4ca94149a528 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:08.484083 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9ee01dbc-4fe9-4d26-8c88-4ca94149a528 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:08.485006 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9ee01dbc-4fe9-4d26-8c88-4ca94149a528 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:08.486306 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-9ee01dbc-4fe9-4d26-8c88-4ca94149a528 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:08.597733 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-c1bbcf39-706f-4f21-8f4f-50190f069187 req-b1778f7c-3894-49d3-b9cc-f88d41257c63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dce7006-cd1a-47c6-8277-069dd009e5e6", "name": "network-vif-unplugged", "status": "completed", "tag": "7f926d08-fc86-4232-a70c-16322f636aa5"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:40:08.607905 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-c1bbcf39-706f-4f21-8f4f-50190f069187 req-b1778f7c-3894-49d3-b9cc-f88d41257c63 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:08.608595 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-c1bbcf39-706f-4f21-8f4f-50190f069187 req-b1778f7c-3894-49d3-b9cc-f88d41257c63 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:08.623197 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.compute.server_external_events [req-c1bbcf39-706f-4f21-8f4f-50190f069187 req-b1778f7c-3894-49d3-b9cc-f88d41257c63 service nova] Unable to find a host for instance 7dce7006-cd1a-47c6-8277-069dd009e5e6. Dropping event network-vif-unplugged {{(pid=118025) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 22 09:40:08.623975 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-c1bbcf39-706f-4f21-8f4f-50190f069187 req-b1778f7c-3894-49d3-b9cc-f88d41257c63 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033024 Jun 22 09:40:08.625128 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 1002/1954] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 22 09:40:08.661284 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-9ee01dbc-4fe9-4d26-8c88-4ca94149a528 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:40:08.669713 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-9ee01dbc-4fe9-4d26-8c88-4ca94149a528 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1508 microversion: 2.1 time: 0.203115 Jun 22 09:40:08.670371 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 953/1955] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:40:08 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1508 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:40:08.685947 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-594c2eb9-c682-4273-9bd7-bbeb1e70037b tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:40:08.686565 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-594c2eb9-c682-4273-9bd7-bbeb1e70037b tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:40:08.693542 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-594c2eb9-c682-4273-9bd7-bbeb1e70037b tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:08.694001 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-594c2eb9-c682-4273-9bd7-bbeb1e70037b tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:08.695440 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-594c2eb9-c682-4273-9bd7-bbeb1e70037b tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:08.695886 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-594c2eb9-c682-4273-9bd7-bbeb1e70037b tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:08.963105 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-594c2eb9-c682-4273-9bd7-bbeb1e70037b tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "POST /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6/action" status: 202 len: 0 microversion: 2.1 time: 0.281171 Jun 22 09:40:08.963910 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 1003/1956] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jun 22 09:40:08 2022] POST /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:40:08.972616 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-3306fd9c-4713-4826-86f3-3909d57a7031 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:40:08.973265 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-3306fd9c-4713-4826-86f3-3909d57a7031 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:40:08.979468 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3306fd9c-4713-4826-86f3-3909d57a7031 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:08.980453 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3306fd9c-4713-4826-86f3-3909d57a7031 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:08.980692 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3306fd9c-4713-4826-86f3-3909d57a7031 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:08.981247 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-3306fd9c-4713-4826-86f3-3909d57a7031 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:09.165688 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-3306fd9c-4713-4826-86f3-3909d57a7031 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:40:09.175005 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-3306fd9c-4713-4826-86f3-3909d57a7031 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1516 microversion: 2.1 time: 0.206909 Jun 22 09:40:09.175591 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 954/1957] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:40:08 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1516 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:40:10.193084 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-99f21c10-9fe2-4c07-9dea-b26aae872183 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:40:10.193714 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-99f21c10-9fe2-4c07-9dea-b26aae872183 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:40:10.200065 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-99f21c10-9fe2-4c07-9dea-b26aae872183 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:10.200533 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-99f21c10-9fe2-4c07-9dea-b26aae872183 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:10.201348 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-99f21c10-9fe2-4c07-9dea-b26aae872183 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:10.201818 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-99f21c10-9fe2-4c07-9dea-b26aae872183 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:10.526722 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-99f21c10-9fe2-4c07-9dea-b26aae872183 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:40:10.536360 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-99f21c10-9fe2-4c07-9dea-b26aae872183 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1516 microversion: 2.1 time: 0.348472 Jun 22 09:40:10.537108 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 1004/1958] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:40:10 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1516 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:40:10.800362 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-37edaee0-bba1-430d-bf50-7d814a38eb20 tempest-VolumesNegativeTest-651794571 tempest-VolumesNegativeTest-651794571-project] Action: 'create', calling method: .version_select at 0x7f5756b2cca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-730007854", "metadata": {"Type": "work"}}} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:40:10.820392 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-37edaee0-bba1-430d-bf50-7d814a38eb20 tempest-VolumesNegativeTest-651794571 tempest-VolumesNegativeTest-651794571-project] Request method failure captured: Jun 22 09:40:10.820392 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 22 09:40:10.820392 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept: application/json Jun 22 09:40:10.820392 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept-Encoding: identity Jun 22 09:40:10.820392 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Connection: close Jun 22 09:40:10.820392 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Length: 121 Jun 22 09:40:10.820392 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Type: application/json Jun 22 09:40:10.820392 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Host: 10.222.0.16 Jun 22 09:40:10.820392 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Openstack-System-Scope: None Jun 22 09:40:10.820392 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: User-Agent: python-urllib3/1.26.9 Jun 22 09:40:10.820392 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Auth-Token: gAAAAABisuN6P7rfrVk9wHDpTs6BmhMM0ktJdcDr4Ir8UYU_uf8Uq0clh3vFR9BxAZg2qYA2yvoizYxXFLkCNe4wgx5Jsb9_ay-YorAmvhlmGoegTw_75qJZ1TGBAZtMM-cSExyxMvWY5WsNyKPjeVtWLDbb4jgBSC9LgxlLpgvdZrlzF3zyRAw Jun 22 09:40:10.820392 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Id: None Jun 22 09:40:10.820392 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Name: None Jun 22 09:40:10.820392 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Identity-Status: Confirmed Jun 22 09:40:10.820392 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Is-Admin-Project: True Jun 22 09:40:10.820392 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Id: default Jun 22 09:40:10.820392 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Name: Default Jun 22 09:40:10.820392 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Id: ed7f0e49eb6945cea01ec154093c9407 Jun 22 09:40:10.820392 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Name: tempest-VolumesNegativeTest-651794571 Jun 22 09:40:10.820392 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Role: member,reader Jun 22 09:40:10.820392 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Roles: member,reader Jun 22 09:40:10.821982 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ed7f0e49eb6945cea01ec154093c9407"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ed7f0e49eb6945cea01ec154093c9407"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ed7f0e49eb6945cea01ec154093c9407"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ed7f0e49eb6945cea01ec154093c9407", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:40:10.821982 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant: tempest-VolumesNegativeTest-651794571 Jun 22 09:40:10.821982 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Id: ed7f0e49eb6945cea01ec154093c9407 Jun 22 09:40:10.821982 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Name: tempest-VolumesNegativeTest-651794571 Jun 22 09:40:10.821982 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User: tempest-VolumesNegativeTest-651794571-project Jun 22 09:40:10.821982 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Id: default Jun 22 09:40:10.821982 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Name: Default Jun 22 09:40:10.821982 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Id: a136808db4614b1f87742f7b6d145380 Jun 22 09:40:10.821982 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Name: tempest-VolumesNegativeTest-651794571-project Jun 22 09:40:10.821982 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Jun 22 09:40:10.821982 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-730007854", "metadata": {"Type": "work"}}} Jun 22 09:40:10.821982 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: method: Jun 22 09:40:10.821982 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 22 09:40:10.823043 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-730007854', 'metadata': {'Type': 'work'}}}} Jun 22 09:40:10.823043 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:40:10.823043 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:10.823043 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 22 09:40:10.823043 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 22 09:40:10.823043 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 22 09:40:10.823043 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise error Jun 22 09:40:10.823043 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 22 09:40:10.823043 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.823043 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 22 09:40:10.823043 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 22 09:40:10.823043 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.823043 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 22 09:40:10.823043 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi '#$%' Jun 22 09:40:10.823043 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.823043 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:40:10.823043 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.823043 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:10.823043 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:40:10.823043 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:40:10.823043 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:40:10.823043 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:40:10.824681 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 09:40:10.824681 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 09:40:10.824681 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:40:10.824681 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:40:10.824681 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 22 09:40:10.824681 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 22 09:40:10.824681 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 22 09:40:10.824681 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 22 09:40:10.824681 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 22 09:40:10.824681 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 22 09:40:10.824681 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 22 09:40:10.824681 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.824681 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:40:10.824681 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.824681 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:10.824681 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:40:10.824681 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:40:10.824681 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 22 09:40:10.824681 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 22 09:40:10.825876 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 22 09:40:10.825876 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.825876 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-37edaee0-bba1-430d-bf50-7d814a38eb20 tempest-VolumesNegativeTest-651794571 tempest-VolumesNegativeTest-651794571-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:40:10.825876 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-37edaee0-bba1-430d-bf50-7d814a38eb20 tempest-VolumesNegativeTest-651794571 tempest-VolumesNegativeTest-651794571-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.150141 Jun 22 09:40:10.825876 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 955/1959] 10.222.0.16 () {60 vars in 1155 bytes} [Wed Jun 22 09:40:10 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 09:40:10.831684 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d05172bb-231e-42cc-b9e8-4a88d537b843 tempest-VolumesNegativeTest-651794571 tempest-VolumesNegativeTest-651794571-project] Action: 'create', calling method: .version_select at 0x7f575621ca60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1791947691", "metadata": {"Type": "work"}}} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:40:10.834909 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d05172bb-231e-42cc-b9e8-4a88d537b843 tempest-VolumesNegativeTest-651794571 tempest-VolumesNegativeTest-651794571-project] Request method failure captured: Jun 22 09:40:10.834909 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 22 09:40:10.834909 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept: application/json Jun 22 09:40:10.834909 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept-Encoding: identity Jun 22 09:40:10.834909 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Connection: close Jun 22 09:40:10.834909 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Length: 120 Jun 22 09:40:10.834909 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Type: application/json Jun 22 09:40:10.834909 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Host: 10.222.0.16 Jun 22 09:40:10.834909 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Openstack-System-Scope: None Jun 22 09:40:10.834909 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: User-Agent: python-urllib3/1.26.9 Jun 22 09:40:10.834909 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Auth-Token: gAAAAABisuN6P7rfrVk9wHDpTs6BmhMM0ktJdcDr4Ir8UYU_uf8Uq0clh3vFR9BxAZg2qYA2yvoizYxXFLkCNe4wgx5Jsb9_ay-YorAmvhlmGoegTw_75qJZ1TGBAZtMM-cSExyxMvWY5WsNyKPjeVtWLDbb4jgBSC9LgxlLpgvdZrlzF3zyRAw Jun 22 09:40:10.834909 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Id: None Jun 22 09:40:10.834909 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Name: None Jun 22 09:40:10.834909 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Identity-Status: Confirmed Jun 22 09:40:10.834909 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Is-Admin-Project: True Jun 22 09:40:10.834909 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Id: default Jun 22 09:40:10.834909 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Name: Default Jun 22 09:40:10.834909 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Id: ed7f0e49eb6945cea01ec154093c9407 Jun 22 09:40:10.834909 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Name: tempest-VolumesNegativeTest-651794571 Jun 22 09:40:10.834909 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Role: member,reader Jun 22 09:40:10.834909 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Roles: member,reader Jun 22 09:40:10.836304 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ed7f0e49eb6945cea01ec154093c9407"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ed7f0e49eb6945cea01ec154093c9407"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ed7f0e49eb6945cea01ec154093c9407"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ed7f0e49eb6945cea01ec154093c9407", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:40:10.836304 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant: tempest-VolumesNegativeTest-651794571 Jun 22 09:40:10.836304 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Id: ed7f0e49eb6945cea01ec154093c9407 Jun 22 09:40:10.836304 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Name: tempest-VolumesNegativeTest-651794571 Jun 22 09:40:10.836304 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User: tempest-VolumesNegativeTest-651794571-project Jun 22 09:40:10.836304 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Id: default Jun 22 09:40:10.836304 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Name: Default Jun 22 09:40:10.836304 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Id: a136808db4614b1f87742f7b6d145380 Jun 22 09:40:10.836304 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Name: tempest-VolumesNegativeTest-651794571-project Jun 22 09:40:10.836304 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Jun 22 09:40:10.836304 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1791947691", "metadata": {"Type": "work"}}} Jun 22 09:40:10.836304 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: method: Jun 22 09:40:10.836304 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 22 09:40:10.837309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1791947691', 'metadata': {'Type': 'work'}}}} Jun 22 09:40:10.837309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:40:10.837309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:10.837309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 22 09:40:10.837309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 22 09:40:10.837309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 22 09:40:10.837309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise error Jun 22 09:40:10.837309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 22 09:40:10.837309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.837309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 22 09:40:10.837309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 22 09:40:10.837309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.837309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 22 09:40:10.837309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi '0' Jun 22 09:40:10.837309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.837309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:40:10.837309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.837309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:10.837309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:40:10.837309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:40:10.837309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:40:10.837309 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:40:10.838842 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 09:40:10.838842 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 09:40:10.838842 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:40:10.838842 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:40:10.838842 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 22 09:40:10.838842 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 22 09:40:10.838842 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 22 09:40:10.838842 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 22 09:40:10.838842 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 22 09:40:10.838842 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 22 09:40:10.838842 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 22 09:40:10.838842 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.838842 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:40:10.838842 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.838842 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:10.838842 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:40:10.838842 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:40:10.838842 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 22 09:40:10.838842 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 22 09:40:10.839913 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 22 09:40:10.839913 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.839913 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-d05172bb-231e-42cc-b9e8-4a88d537b843 tempest-VolumesNegativeTest-651794571 tempest-VolumesNegativeTest-651794571-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:40:10.839913 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-d05172bb-231e-42cc-b9e8-4a88d537b843 tempest-VolumesNegativeTest-651794571 tempest-VolumesNegativeTest-651794571-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008571 Jun 22 09:40:10.839913 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 1005/1960] 10.222.0.16 () {60 vars in 1155 bytes} [Wed Jun 22 09:40:10 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 09:40:10.846128 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-571b4ac8-57ca-4e5c-84f1-e073bc1434fb tempest-VolumesNegativeTest-651794571 tempest-VolumesNegativeTest-651794571-project] Action: 'create', calling method: .version_select at 0x7f5756b38790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2128957720", "metadata": {"Type": "work"}}} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:40:10.853002 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-571b4ac8-57ca-4e5c-84f1-e073bc1434fb tempest-VolumesNegativeTest-651794571 tempest-VolumesNegativeTest-651794571-project] Request method failure captured: Jun 22 09:40:10.853002 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 22 09:40:10.853002 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept: application/json Jun 22 09:40:10.853002 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept-Encoding: identity Jun 22 09:40:10.853002 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Connection: close Jun 22 09:40:10.853002 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Length: 119 Jun 22 09:40:10.853002 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Type: application/json Jun 22 09:40:10.853002 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Host: 10.222.0.16 Jun 22 09:40:10.853002 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Openstack-System-Scope: None Jun 22 09:40:10.853002 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: User-Agent: python-urllib3/1.26.9 Jun 22 09:40:10.853002 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Auth-Token: gAAAAABisuN6P7rfrVk9wHDpTs6BmhMM0ktJdcDr4Ir8UYU_uf8Uq0clh3vFR9BxAZg2qYA2yvoizYxXFLkCNe4wgx5Jsb9_ay-YorAmvhlmGoegTw_75qJZ1TGBAZtMM-cSExyxMvWY5WsNyKPjeVtWLDbb4jgBSC9LgxlLpgvdZrlzF3zyRAw Jun 22 09:40:10.853002 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Id: None Jun 22 09:40:10.853002 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Name: None Jun 22 09:40:10.853002 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Identity-Status: Confirmed Jun 22 09:40:10.853002 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Is-Admin-Project: True Jun 22 09:40:10.853002 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Id: default Jun 22 09:40:10.853002 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Name: Default Jun 22 09:40:10.853002 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Id: ed7f0e49eb6945cea01ec154093c9407 Jun 22 09:40:10.853002 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Name: tempest-VolumesNegativeTest-651794571 Jun 22 09:40:10.853002 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Role: member,reader Jun 22 09:40:10.853002 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Roles: member,reader Jun 22 09:40:10.854659 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ed7f0e49eb6945cea01ec154093c9407"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ed7f0e49eb6945cea01ec154093c9407"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ed7f0e49eb6945cea01ec154093c9407"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ed7f0e49eb6945cea01ec154093c9407", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:40:10.854659 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant: tempest-VolumesNegativeTest-651794571 Jun 22 09:40:10.854659 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Id: ed7f0e49eb6945cea01ec154093c9407 Jun 22 09:40:10.854659 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Name: tempest-VolumesNegativeTest-651794571 Jun 22 09:40:10.854659 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User: tempest-VolumesNegativeTest-651794571-project Jun 22 09:40:10.854659 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Id: default Jun 22 09:40:10.854659 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Name: Default Jun 22 09:40:10.854659 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Id: a136808db4614b1f87742f7b6d145380 Jun 22 09:40:10.854659 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Name: tempest-VolumesNegativeTest-651794571-project Jun 22 09:40:10.854659 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Jun 22 09:40:10.854659 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2128957720", "metadata": {"Type": "work"}}} Jun 22 09:40:10.854659 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: method: Jun 22 09:40:10.854659 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 22 09:40:10.855412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2128957720', 'metadata': {'Type': 'work'}}}} Jun 22 09:40:10.855412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:40:10.855412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:10.855412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 22 09:40:10.855412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 22 09:40:10.855412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 22 09:40:10.855412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise error Jun 22 09:40:10.855412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 22 09:40:10.855412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.855412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 22 09:40:10.855412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 22 09:40:10.855412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.855412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 22 09:40:10.855412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi '' Jun 22 09:40:10.855412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.855412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:40:10.855412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.855412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:10.855412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:40:10.855412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:40:10.855412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:40:10.855412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:40:10.856738 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 09:40:10.856738 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 09:40:10.856738 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:40:10.856738 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:40:10.856738 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 22 09:40:10.856738 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 22 09:40:10.856738 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 22 09:40:10.856738 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 22 09:40:10.856738 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 22 09:40:10.856738 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 22 09:40:10.856738 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 22 09:40:10.856738 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.856738 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:40:10.856738 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.856738 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:10.856738 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:40:10.856738 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:40:10.856738 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 22 09:40:10.856738 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 22 09:40:10.858409 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 22 09:40:10.858409 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.858409 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-571b4ac8-57ca-4e5c-84f1-e073bc1434fb tempest-VolumesNegativeTest-651794571 tempest-VolumesNegativeTest-651794571-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:40:10.858409 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-571b4ac8-57ca-4e5c-84f1-e073bc1434fb tempest-VolumesNegativeTest-651794571 tempest-VolumesNegativeTest-651794571-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007826 Jun 22 09:40:10.858409 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 956/1961] 10.222.0.16 () {60 vars in 1155 bytes} [Wed Jun 22 09:40:10 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 22 09:40:10.861387 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-be08d4cb-f92a-4bee-9396-3254466d1d78 tempest-VolumesNegativeTest-651794571 tempest-VolumesNegativeTest-651794571-project] Calling method '.version_select at 0x7f5756304af0>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:40:10.890623 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.wsgi [None req-be08d4cb-f92a-4bee-9396-3254466d1d78 tempest-VolumesNegativeTest-651794571 tempest-VolumesNegativeTest-651794571-project] HTTP exception thrown: Volume tempest-invalid-2055775490 could not be found. Jun 22 09:40:10.893560 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-be08d4cb-f92a-4bee-9396-3254466d1d78 tempest-VolumesNegativeTest-651794571 tempest-VolumesNegativeTest-651794571-project] Request method failure captured: Jun 22 09:40:10.893560 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2055775490 HTTP/1.1 Jun 22 09:40:10.893560 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept: application/json Jun 22 09:40:10.893560 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept-Encoding: identity Jun 22 09:40:10.893560 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Connection: close Jun 22 09:40:10.893560 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Length: 0 Jun 22 09:40:10.893560 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Type: application/json Jun 22 09:40:10.893560 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Host: 10.222.0.16 Jun 22 09:40:10.893560 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Openstack-System-Scope: None Jun 22 09:40:10.893560 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: User-Agent: python-urllib3/1.26.9 Jun 22 09:40:10.893560 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Auth-Token: gAAAAABisuN6P7rfrVk9wHDpTs6BmhMM0ktJdcDr4Ir8UYU_uf8Uq0clh3vFR9BxAZg2qYA2yvoizYxXFLkCNe4wgx5Jsb9_ay-YorAmvhlmGoegTw_75qJZ1TGBAZtMM-cSExyxMvWY5WsNyKPjeVtWLDbb4jgBSC9LgxlLpgvdZrlzF3zyRAw Jun 22 09:40:10.893560 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Id: None Jun 22 09:40:10.893560 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Name: None Jun 22 09:40:10.893560 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Identity-Status: Confirmed Jun 22 09:40:10.893560 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Is-Admin-Project: True Jun 22 09:40:10.893560 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Id: default Jun 22 09:40:10.893560 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Name: Default Jun 22 09:40:10.893560 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Id: ed7f0e49eb6945cea01ec154093c9407 Jun 22 09:40:10.893560 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Name: tempest-VolumesNegativeTest-651794571 Jun 22 09:40:10.893560 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Role: member,reader Jun 22 09:40:10.893560 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Roles: member,reader Jun 22 09:40:10.895301 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ed7f0e49eb6945cea01ec154093c9407"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ed7f0e49eb6945cea01ec154093c9407"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ed7f0e49eb6945cea01ec154093c9407"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ed7f0e49eb6945cea01ec154093c9407", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:40:10.895301 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant: tempest-VolumesNegativeTest-651794571 Jun 22 09:40:10.895301 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Id: ed7f0e49eb6945cea01ec154093c9407 Jun 22 09:40:10.895301 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Name: tempest-VolumesNegativeTest-651794571 Jun 22 09:40:10.895301 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User: tempest-VolumesNegativeTest-651794571-project Jun 22 09:40:10.895301 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Id: default Jun 22 09:40:10.895301 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Name: Default Jun 22 09:40:10.895301 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Id: a136808db4614b1f87742f7b6d145380 Jun 22 09:40:10.895301 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Name: tempest-VolumesNegativeTest-651794571-project Jun 22 09:40:10.895301 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: method: Jun 22 09:40:10.895301 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: exception: Volume tempest-invalid-2055775490 could not be found. Jun 22 09:40:10.895301 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: action_args: {'id': 'tempest-invalid-2055775490'} Jun 22 09:40:10.895301 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:40:10.896431 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:10.896431 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:40:10.896431 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:40:10.896431 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 09:40:10.896431 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 09:40:10.896431 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 09:40:10.896431 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 09:40:10.896431 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 09:40:10.896431 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 09:40:10.896431 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 09:40:10.896431 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 09:40:10.896431 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:40:10.896431 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:40:10.896431 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:40:10.896431 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:40:10.896431 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2055775490 could not be found. (HTTP 404) (Request-ID: req-3b40c34f-d63a-4c93-b804-048112e2c27b) Jun 22 09:40:10.896431 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.896431 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:40:10.896431 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.897898 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:10.897898 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 22 09:40:10.897898 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 22 09:40:10.897898 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 09:40:10.897898 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 09:40:10.897898 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 09:40:10.897898 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 09:40:10.897898 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 09:40:10.897898 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 09:40:10.897898 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:40:10.897898 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:40:10.897898 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 09:40:10.897898 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 09:40:10.897898 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 09:40:10.897898 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 09:40:10.897898 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 09:40:10.897898 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 09:40:10.897898 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 09:40:10.897898 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 09:40:10.899071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:40:10.899071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:40:10.899071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:40:10.899071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:40:10.899071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2055775490 could not be found. Jun 22 09:40:10.899071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.899071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:40:10.899071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.899071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:10.899071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:40:10.899071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:40:10.899071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:40:10.899071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:40:10.899071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 09:40:10.899071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 09:40:10.899071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:40:10.899071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:40:10.899071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 22 09:40:10.899071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:40:10.899071 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2055775490 could not be found. Jun 22 09:40:10.900407 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.900407 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:40:10.900407 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.900407 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:10.900407 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:40:10.900407 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:40:10.900407 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:40:10.900407 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:40:10.900407 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2055775490 could not be found. Jun 22 09:40:10.900407 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.900407 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-be08d4cb-f92a-4bee-9396-3254466d1d78 tempest-VolumesNegativeTest-651794571 tempest-VolumesNegativeTest-651794571-project] Returning 404 to user: Volume tempest-invalid-2055775490 could not be found. {{(pid=118025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:40:10.900407 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-be08d4cb-f92a-4bee-9396-3254466d1d78 tempest-VolumesNegativeTest-651794571 tempest-VolumesNegativeTest-651794571-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2055775490" status: 404 len: 99 microversion: 2.1 time: 0.038252 Jun 22 09:40:10.900407 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 1006/1962] 10.222.0.16 () {58 vars in 1217 bytes} [Wed Jun 22 09:40:10 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2055775490 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 22 09:40:10.905854 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-bfc798d0-f781-4c02-979f-e07e27fa7f29 tempest-VolumesNegativeTest-651794571 tempest-VolumesNegativeTest-651794571-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003796 Jun 22 09:40:10.906356 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 957/1963] 10.222.0.16 () {58 vars in 1139 bytes} [Wed Jun 22 09:40:10 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 22 09:40:10.915405 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-b2cdeacc-cb01-4c3e-9623-907dd9363c4e tempest-VolumesNegativeTest-651794571 tempest-VolumesNegativeTest-651794571-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003813 Jun 22 09:40:10.915926 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 1007/1964] 10.222.0.16 () {58 vars in 1136 bytes} [Wed Jun 22 09:40:10 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 22 09:40:10.930876 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1f324879-99ae-4fdd-8d2e-25f853ae0856 tempest-VolumesNegativeTest-651794571 tempest-VolumesNegativeTest-651794571-project] Calling method '.version_select at 0x7f5756cf5e50>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:40:10.959635 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.wsgi [None req-1f324879-99ae-4fdd-8d2e-25f853ae0856 tempest-VolumesNegativeTest-651794571 tempest-VolumesNegativeTest-651794571-project] HTTP exception thrown: Volume 0a429f91-e8ad-462f-9e28-3e6798c30634 could not be found. Jun 22 09:40:10.961620 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1f324879-99ae-4fdd-8d2e-25f853ae0856 tempest-VolumesNegativeTest-651794571 tempest-VolumesNegativeTest-651794571-project] Request method failure captured: Jun 22 09:40:10.961620 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: request: DELETE /compute/v2.1/os-volumes/0a429f91-e8ad-462f-9e28-3e6798c30634 HTTP/1.1 Jun 22 09:40:10.961620 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept: application/json Jun 22 09:40:10.961620 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept-Encoding: identity Jun 22 09:40:10.961620 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Connection: close Jun 22 09:40:10.961620 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Length: 0 Jun 22 09:40:10.961620 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Type: application/json Jun 22 09:40:10.961620 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Host: 10.222.0.16 Jun 22 09:40:10.961620 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Openstack-System-Scope: None Jun 22 09:40:10.961620 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: User-Agent: python-urllib3/1.26.9 Jun 22 09:40:10.961620 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Auth-Token: gAAAAABisuN6P7rfrVk9wHDpTs6BmhMM0ktJdcDr4Ir8UYU_uf8Uq0clh3vFR9BxAZg2qYA2yvoizYxXFLkCNe4wgx5Jsb9_ay-YorAmvhlmGoegTw_75qJZ1TGBAZtMM-cSExyxMvWY5WsNyKPjeVtWLDbb4jgBSC9LgxlLpgvdZrlzF3zyRAw Jun 22 09:40:10.961620 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Id: None Jun 22 09:40:10.961620 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Name: None Jun 22 09:40:10.961620 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Identity-Status: Confirmed Jun 22 09:40:10.961620 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Is-Admin-Project: True Jun 22 09:40:10.961620 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Id: default Jun 22 09:40:10.961620 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Name: Default Jun 22 09:40:10.961620 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Id: ed7f0e49eb6945cea01ec154093c9407 Jun 22 09:40:10.961620 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Name: tempest-VolumesNegativeTest-651794571 Jun 22 09:40:10.961620 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Role: member,reader Jun 22 09:40:10.961620 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Roles: member,reader Jun 22 09:40:10.963065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ed7f0e49eb6945cea01ec154093c9407"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ed7f0e49eb6945cea01ec154093c9407"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ed7f0e49eb6945cea01ec154093c9407"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ed7f0e49eb6945cea01ec154093c9407", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:40:10.963065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant: tempest-VolumesNegativeTest-651794571 Jun 22 09:40:10.963065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Id: ed7f0e49eb6945cea01ec154093c9407 Jun 22 09:40:10.963065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Name: tempest-VolumesNegativeTest-651794571 Jun 22 09:40:10.963065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User: tempest-VolumesNegativeTest-651794571-project Jun 22 09:40:10.963065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Id: default Jun 22 09:40:10.963065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Name: Default Jun 22 09:40:10.963065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Id: a136808db4614b1f87742f7b6d145380 Jun 22 09:40:10.963065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Name: tempest-VolumesNegativeTest-651794571-project Jun 22 09:40:10.963065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: method: Jun 22 09:40:10.963065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: exception: Volume 0a429f91-e8ad-462f-9e28-3e6798c30634 could not be found. Jun 22 09:40:10.963065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: action_args: {'id': '0a429f91-e8ad-462f-9e28-3e6798c30634'} Jun 22 09:40:10.963065 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:40:10.963976 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:10.963976 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:40:10.963976 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:40:10.963976 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 09:40:10.963976 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 09:40:10.963976 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 09:40:10.963976 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 09:40:10.963976 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 09:40:10.963976 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 09:40:10.963976 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 09:40:10.963976 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 09:40:10.963976 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:40:10.963976 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:40:10.963976 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:40:10.963976 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:40:10.963976 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0a429f91-e8ad-462f-9e28-3e6798c30634 could not be found. (HTTP 404) (Request-ID: req-8b5bf244-2818-4945-afe3-d61e46d02383) Jun 22 09:40:10.963976 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.963976 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:40:10.963976 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.965053 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:10.965053 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 22 09:40:10.965053 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 22 09:40:10.965053 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 09:40:10.965053 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 09:40:10.965053 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 09:40:10.965053 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 09:40:10.965053 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 09:40:10.965053 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 09:40:10.965053 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:40:10.965053 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:40:10.965053 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 09:40:10.965053 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 09:40:10.965053 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 09:40:10.965053 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 09:40:10.965053 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 09:40:10.965053 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 09:40:10.965053 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 09:40:10.965053 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 09:40:10.966067 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:40:10.966067 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:40:10.966067 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:40:10.966067 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:40:10.966067 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0a429f91-e8ad-462f-9e28-3e6798c30634 could not be found. Jun 22 09:40:10.966067 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.966067 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:40:10.966067 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.966067 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:10.966067 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:40:10.966067 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:40:10.966067 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:40:10.966067 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:40:10.966067 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 09:40:10.966067 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 09:40:10.966067 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:40:10.966067 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:40:10.966067 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 22 09:40:10.966067 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:40:10.967259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0a429f91-e8ad-462f-9e28-3e6798c30634 could not be found. Jun 22 09:40:10.967259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.967259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:40:10.967259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.967259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:10.967259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:40:10.967259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:40:10.967259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:40:10.967259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:40:10.967259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0a429f91-e8ad-462f-9e28-3e6798c30634 could not be found. Jun 22 09:40:10.967259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:10.967259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1f324879-99ae-4fdd-8d2e-25f853ae0856 tempest-VolumesNegativeTest-651794571 tempest-VolumesNegativeTest-651794571-project] Returning 404 to user: Volume 0a429f91-e8ad-462f-9e28-3e6798c30634 could not be found. {{(pid=118024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:40:10.967259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1f324879-99ae-4fdd-8d2e-25f853ae0856 tempest-VolumesNegativeTest-651794571 tempest-VolumesNegativeTest-651794571-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/0a429f91-e8ad-462f-9e28-3e6798c30634" status: 404 len: 109 microversion: 2.1 time: 0.036001 Jun 22 09:40:10.967259 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 958/1965] 10.222.0.16 () {58 vars in 1247 bytes} [Wed Jun 22 09:40:10 2022] DELETE /compute/v2.1/os-volumes/0a429f91-e8ad-462f-9e28-3e6798c30634 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:40:10.981727 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-956b2a87-6644-4360-b247-fd565130c413 tempest-VolumesNegativeTest-651794571 tempest-VolumesNegativeTest-651794571-project] Calling method '.version_select at 0x7f575616e430>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:40:11.020508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.wsgi [None req-956b2a87-6644-4360-b247-fd565130c413 tempest-VolumesNegativeTest-651794571 tempest-VolumesNegativeTest-651794571-project] HTTP exception thrown: Volume 98d80d57-1825-4b3d-8d15-3ca12052d67f could not be found. Jun 22 09:40:11.020508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-956b2a87-6644-4360-b247-fd565130c413 tempest-VolumesNegativeTest-651794571 tempest-VolumesNegativeTest-651794571-project] Request method failure captured: Jun 22 09:40:11.020508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: request: GET /compute/v2.1/os-volumes/98d80d57-1825-4b3d-8d15-3ca12052d67f HTTP/1.1 Jun 22 09:40:11.020508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept: application/json Jun 22 09:40:11.020508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept-Encoding: identity Jun 22 09:40:11.020508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Connection: close Jun 22 09:40:11.020508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Length: 0 Jun 22 09:40:11.020508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Type: application/json Jun 22 09:40:11.020508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Host: 10.222.0.16 Jun 22 09:40:11.020508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Openstack-System-Scope: None Jun 22 09:40:11.020508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: User-Agent: python-urllib3/1.26.9 Jun 22 09:40:11.020508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Auth-Token: gAAAAABisuN6P7rfrVk9wHDpTs6BmhMM0ktJdcDr4Ir8UYU_uf8Uq0clh3vFR9BxAZg2qYA2yvoizYxXFLkCNe4wgx5Jsb9_ay-YorAmvhlmGoegTw_75qJZ1TGBAZtMM-cSExyxMvWY5WsNyKPjeVtWLDbb4jgBSC9LgxlLpgvdZrlzF3zyRAw Jun 22 09:40:11.020508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Id: None Jun 22 09:40:11.020508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Name: None Jun 22 09:40:11.020508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Identity-Status: Confirmed Jun 22 09:40:11.020508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Is-Admin-Project: True Jun 22 09:40:11.020508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Id: default Jun 22 09:40:11.020508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Name: Default Jun 22 09:40:11.020508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Id: ed7f0e49eb6945cea01ec154093c9407 Jun 22 09:40:11.020508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Name: tempest-VolumesNegativeTest-651794571 Jun 22 09:40:11.020508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Role: member,reader Jun 22 09:40:11.020508 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Roles: member,reader Jun 22 09:40:11.022022 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ed7f0e49eb6945cea01ec154093c9407"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ed7f0e49eb6945cea01ec154093c9407"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ed7f0e49eb6945cea01ec154093c9407"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ed7f0e49eb6945cea01ec154093c9407", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:40:11.022022 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant: tempest-VolumesNegativeTest-651794571 Jun 22 09:40:11.022022 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Id: ed7f0e49eb6945cea01ec154093c9407 Jun 22 09:40:11.022022 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Name: tempest-VolumesNegativeTest-651794571 Jun 22 09:40:11.022022 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User: tempest-VolumesNegativeTest-651794571-project Jun 22 09:40:11.022022 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Id: default Jun 22 09:40:11.022022 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Name: Default Jun 22 09:40:11.022022 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Id: a136808db4614b1f87742f7b6d145380 Jun 22 09:40:11.022022 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Name: tempest-VolumesNegativeTest-651794571-project Jun 22 09:40:11.022022 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: method: Jun 22 09:40:11.022022 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: exception: Volume 98d80d57-1825-4b3d-8d15-3ca12052d67f could not be found. Jun 22 09:40:11.022022 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: action_args: {'id': '98d80d57-1825-4b3d-8d15-3ca12052d67f'} Jun 22 09:40:11.022022 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:40:11.022971 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:11.022971 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:40:11.022971 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:40:11.022971 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 09:40:11.022971 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 09:40:11.022971 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 09:40:11.022971 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 09:40:11.022971 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 09:40:11.022971 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 09:40:11.022971 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 09:40:11.022971 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 09:40:11.022971 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:40:11.022971 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:40:11.022971 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:40:11.022971 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:40:11.022971 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 98d80d57-1825-4b3d-8d15-3ca12052d67f could not be found. (HTTP 404) (Request-ID: req-3a04ce93-d4cf-43ad-9d10-b54754454260) Jun 22 09:40:11.022971 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:11.022971 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:40:11.022971 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:11.024266 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:11.024266 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 09:40:11.024266 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 09:40:11.024266 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 09:40:11.024266 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 09:40:11.024266 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 09:40:11.024266 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 09:40:11.024266 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 09:40:11.024266 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 09:40:11.024266 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:40:11.024266 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:40:11.024266 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 09:40:11.024266 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 09:40:11.024266 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 09:40:11.024266 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 09:40:11.024266 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 09:40:11.024266 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 09:40:11.024266 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 09:40:11.024266 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 09:40:11.025536 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:40:11.025536 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:40:11.025536 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:40:11.025536 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:40:11.025536 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 98d80d57-1825-4b3d-8d15-3ca12052d67f could not be found. Jun 22 09:40:11.025536 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:11.025536 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:40:11.025536 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:11.025536 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:11.025536 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:40:11.025536 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:40:11.025536 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:40:11.025536 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:40:11.025536 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 09:40:11.025536 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 09:40:11.025536 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:40:11.025536 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:40:11.025536 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 09:40:11.025536 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:40:11.026849 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 98d80d57-1825-4b3d-8d15-3ca12052d67f could not be found. Jun 22 09:40:11.026849 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:11.026849 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:40:11.026849 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:11.026849 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:11.026849 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:40:11.026849 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:40:11.026849 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:40:11.026849 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:40:11.026849 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 98d80d57-1825-4b3d-8d15-3ca12052d67f could not be found. Jun 22 09:40:11.026849 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:11.026849 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-956b2a87-6644-4360-b247-fd565130c413 tempest-VolumesNegativeTest-651794571 tempest-VolumesNegativeTest-651794571-project] Returning 404 to user: Volume 98d80d57-1825-4b3d-8d15-3ca12052d67f could not be found. {{(pid=118025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:40:11.026849 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-956b2a87-6644-4360-b247-fd565130c413 tempest-VolumesNegativeTest-651794571 tempest-VolumesNegativeTest-651794571-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/98d80d57-1825-4b3d-8d15-3ca12052d67f" status: 404 len: 109 microversion: 2.1 time: 0.038454 Jun 22 09:40:11.026849 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 1008/1966] 10.222.0.16 () {58 vars in 1244 bytes} [Wed Jun 22 09:40:10 2022] GET /compute/v2.1/os-volumes/98d80d57-1825-4b3d-8d15-3ca12052d67f => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 09:40:11.554552 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-b18a1ca6-f187-4f89-a4ab-627fd57999cb tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:40:11.555169 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-b18a1ca6-f187-4f89-a4ab-627fd57999cb tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:40:11.561937 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b18a1ca6-f187-4f89-a4ab-627fd57999cb tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:11.562392 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b18a1ca6-f187-4f89-a4ab-627fd57999cb tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:11.563216 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b18a1ca6-f187-4f89-a4ab-627fd57999cb tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:11.563664 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-b18a1ca6-f187-4f89-a4ab-627fd57999cb tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:11.720646 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-b18a1ca6-f187-4f89-a4ab-627fd57999cb tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:40:11.728260 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-b18a1ca6-f187-4f89-a4ab-627fd57999cb tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1518 microversion: 2.1 time: 0.177639 Jun 22 09:40:11.728837 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 959/1967] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:40:11 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1518 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:40:12.748333 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-6da71168-b1ba-4eb5-9fea-5735ff64dcd7 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:40:12.750128 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-6da71168-b1ba-4eb5-9fea-5735ff64dcd7 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:40:12.758393 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6da71168-b1ba-4eb5-9fea-5735ff64dcd7 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:12.758825 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6da71168-b1ba-4eb5-9fea-5735ff64dcd7 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:12.759642 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6da71168-b1ba-4eb5-9fea-5735ff64dcd7 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:12.760129 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-6da71168-b1ba-4eb5-9fea-5735ff64dcd7 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:12.927631 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-6da71168-b1ba-4eb5-9fea-5735ff64dcd7 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:40:12.936999 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-6da71168-b1ba-4eb5-9fea-5735ff64dcd7 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1574 microversion: 2.1 time: 0.194223 Jun 22 09:40:12.959164 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 1009/1968] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:40:12 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1574 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:40:13.966388 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-1c0a7435-35f8-41c7-87ee-8fa6849fa457 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:40:13.967122 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-1c0a7435-35f8-41c7-87ee-8fa6849fa457 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:40:13.974911 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1c0a7435-35f8-41c7-87ee-8fa6849fa457 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:13.975371 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1c0a7435-35f8-41c7-87ee-8fa6849fa457 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:13.976152 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1c0a7435-35f8-41c7-87ee-8fa6849fa457 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:13.976626 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-1c0a7435-35f8-41c7-87ee-8fa6849fa457 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:14.122914 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-1c0a7435-35f8-41c7-87ee-8fa6849fa457 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:40:14.132820 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-1c0a7435-35f8-41c7-87ee-8fa6849fa457 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1574 microversion: 2.1 time: 0.170299 Jun 22 09:40:14.133422 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 960/1969] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:40:13 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:40:15.152561 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-b1e601d1-dc58-4031-954c-048a2ca7ea4c tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:40:15.153225 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-b1e601d1-dc58-4031-954c-048a2ca7ea4c tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:40:15.161091 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b1e601d1-dc58-4031-954c-048a2ca7ea4c tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:15.161545 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b1e601d1-dc58-4031-954c-048a2ca7ea4c tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:15.162336 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b1e601d1-dc58-4031-954c-048a2ca7ea4c tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:15.162776 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-b1e601d1-dc58-4031-954c-048a2ca7ea4c tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:15.306731 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-b1e601d1-dc58-4031-954c-048a2ca7ea4c tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:40:15.314550 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-b1e601d1-dc58-4031-954c-048a2ca7ea4c tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1574 microversion: 2.1 time: 0.166206 Jun 22 09:40:15.315230 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 1010/1970] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:40:15 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:40:16.335969 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-c74f31a2-4e65-4ec4-88e1-3aa8af5b07ab tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:40:16.336584 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-c74f31a2-4e65-4ec4-88e1-3aa8af5b07ab tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:40:16.343820 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c74f31a2-4e65-4ec4-88e1-3aa8af5b07ab tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:16.344194 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c74f31a2-4e65-4ec4-88e1-3aa8af5b07ab tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:16.345870 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c74f31a2-4e65-4ec4-88e1-3aa8af5b07ab tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:16.346588 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-c74f31a2-4e65-4ec4-88e1-3aa8af5b07ab tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:16.564206 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-c74f31a2-4e65-4ec4-88e1-3aa8af5b07ab tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:40:16.571164 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-c74f31a2-4e65-4ec4-88e1-3aa8af5b07ab tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1574 microversion: 2.1 time: 0.243707 Jun 22 09:40:16.571752 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 961/1971] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:40:16 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1574 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:40:17.588832 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-7f5f19c8-b24f-4f8a-8f5b-563ae59db704 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:40:17.589456 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-7f5f19c8-b24f-4f8a-8f5b-563ae59db704 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:40:17.596988 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7f5f19c8-b24f-4f8a-8f5b-563ae59db704 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:17.597440 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7f5f19c8-b24f-4f8a-8f5b-563ae59db704 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:17.598229 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7f5f19c8-b24f-4f8a-8f5b-563ae59db704 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:17.598671 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-7f5f19c8-b24f-4f8a-8f5b-563ae59db704 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:17.746888 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-7f5f19c8-b24f-4f8a-8f5b-563ae59db704 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:40:17.755029 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-7f5f19c8-b24f-4f8a-8f5b-563ae59db704 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1574 microversion: 2.1 time: 0.170279 Jun 22 09:40:17.755615 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 1011/1972] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:40:17 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:40:18.771804 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-01656577-2d7e-407a-93f4-159bb7518492 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:40:18.772412 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-01656577-2d7e-407a-93f4-159bb7518492 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:40:18.778960 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-01656577-2d7e-407a-93f4-159bb7518492 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:18.779405 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-01656577-2d7e-407a-93f4-159bb7518492 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:18.780164 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-01656577-2d7e-407a-93f4-159bb7518492 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:18.780601 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-01656577-2d7e-407a-93f4-159bb7518492 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:18.915871 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-01656577-2d7e-407a-93f4-159bb7518492 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:40:18.924208 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-01656577-2d7e-407a-93f4-159bb7518492 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1574 microversion: 2.1 time: 0.156122 Jun 22 09:40:18.924803 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 962/1973] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:40:18 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:40:19.941973 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-0d689261-ee8b-4056-8005-cca67aac59dc tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:40:19.942595 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-0d689261-ee8b-4056-8005-cca67aac59dc tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:40:19.948849 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0d689261-ee8b-4056-8005-cca67aac59dc tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:19.949299 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0d689261-ee8b-4056-8005-cca67aac59dc tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:19.950064 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0d689261-ee8b-4056-8005-cca67aac59dc tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:19.950499 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-0d689261-ee8b-4056-8005-cca67aac59dc tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:19.970864 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:40:20.088225 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-0d689261-ee8b-4056-8005-cca67aac59dc tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:40:20.097501 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-0d689261-ee8b-4056-8005-cca67aac59dc tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1574 microversion: 2.1 time: 0.159467 Jun 22 09:40:20.097692 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 1012/1974] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:40:19 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:40:21.117595 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-83c7e14b-076c-4666-93ee-b32bd7ff28e1 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:40:21.118227 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-83c7e14b-076c-4666-93ee-b32bd7ff28e1 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:40:21.124996 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-83c7e14b-076c-4666-93ee-b32bd7ff28e1 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:21.125454 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-83c7e14b-076c-4666-93ee-b32bd7ff28e1 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:21.126454 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-83c7e14b-076c-4666-93ee-b32bd7ff28e1 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:21.126898 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-83c7e14b-076c-4666-93ee-b32bd7ff28e1 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:21.285176 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-83c7e14b-076c-4666-93ee-b32bd7ff28e1 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:40:21.293631 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-83c7e14b-076c-4666-93ee-b32bd7ff28e1 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1574 microversion: 2.1 time: 0.179905 Jun 22 09:40:21.294478 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 963/1975] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:40:21 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1574 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:40:22.312023 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-2506f99d-084f-4a66-af13-4a40629a3d73 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:40:22.312632 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-2506f99d-084f-4a66-af13-4a40629a3d73 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:40:22.320150 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2506f99d-084f-4a66-af13-4a40629a3d73 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:22.320591 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2506f99d-084f-4a66-af13-4a40629a3d73 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:22.321372 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2506f99d-084f-4a66-af13-4a40629a3d73 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:22.321802 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-2506f99d-084f-4a66-af13-4a40629a3d73 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:22.459312 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-2506f99d-084f-4a66-af13-4a40629a3d73 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:40:22.467118 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-2506f99d-084f-4a66-af13-4a40629a3d73 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1574 microversion: 2.1 time: 0.158838 Jun 22 09:40:22.467614 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 1013/1976] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:40:22 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:40:23.483531 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-7fae0ef6-1a91-491a-adbf-6eb5c4df43d2 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:40:23.484151 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-7fae0ef6-1a91-491a-adbf-6eb5c4df43d2 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:40:23.491369 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7fae0ef6-1a91-491a-adbf-6eb5c4df43d2 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:23.491820 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7fae0ef6-1a91-491a-adbf-6eb5c4df43d2 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:23.497487 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7fae0ef6-1a91-491a-adbf-6eb5c4df43d2 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:23.497487 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7fae0ef6-1a91-491a-adbf-6eb5c4df43d2 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:23.625344 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-7fae0ef6-1a91-491a-adbf-6eb5c4df43d2 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:40:23.628199 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=87 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:40:23.634184 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-7fae0ef6-1a91-491a-adbf-6eb5c4df43d2 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1574 microversion: 2.1 time: 0.154729 Jun 22 09:40:23.634742 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 964/1977] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:40:23 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:40:24.654884 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-548982f4-eccd-4d64-befc-d4f792a0770f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:40:24.655503 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-548982f4-eccd-4d64-befc-d4f792a0770f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:40:24.658560 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=37 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:40:24.663426 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-548982f4-eccd-4d64-befc-d4f792a0770f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:24.663883 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-548982f4-eccd-4d64-befc-d4f792a0770f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:24.664661 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-548982f4-eccd-4d64-befc-d4f792a0770f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:24.665135 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-548982f4-eccd-4d64-befc-d4f792a0770f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:24.804221 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-548982f4-eccd-4d64-befc-d4f792a0770f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:40:24.814534 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-548982f4-eccd-4d64-befc-d4f792a0770f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1574 microversion: 2.1 time: 0.163536 Jun 22 09:40:24.815031 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 1014/1978] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:40:24 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:40:25.832141 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-7cf518a3-01a0-4ac3-84d9-44fc9bf06e73 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:40:25.832811 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-7cf518a3-01a0-4ac3-84d9-44fc9bf06e73 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:40:25.835100 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=33 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:40:25.839948 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7cf518a3-01a0-4ac3-84d9-44fc9bf06e73 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:25.840389 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7cf518a3-01a0-4ac3-84d9-44fc9bf06e73 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:25.841187 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7cf518a3-01a0-4ac3-84d9-44fc9bf06e73 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:25.841688 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7cf518a3-01a0-4ac3-84d9-44fc9bf06e73 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:25.987960 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-7cf518a3-01a0-4ac3-84d9-44fc9bf06e73 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:40:25.996486 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-7cf518a3-01a0-4ac3-84d9-44fc9bf06e73 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1574 microversion: 2.1 time: 0.168797 Jun 22 09:40:25.997102 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 965/1979] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:40:25 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:40:26.587800 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-685fa9b7-30b5-4237-9313-ef721f97a4de req-af6cdf68-b055-4493-88d8-645fa0281f8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dce7006-cd1a-47c6-8277-069dd009e5e6", "name": "network-vif-plugged", "status": "completed", "tag": "7f926d08-fc86-4232-a70c-16322f636aa5"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:40:26.598127 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-685fa9b7-30b5-4237-9313-ef721f97a4de req-af6cdf68-b055-4493-88d8-645fa0281f8e service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:26.598602 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-685fa9b7-30b5-4237-9313-ef721f97a4de req-af6cdf68-b055-4493-88d8-645fa0281f8e service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:26.609804 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-685fa9b7-30b5-4237-9313-ef721f97a4de req-af6cdf68-b055-4493-88d8-645fa0281f8e service nova] Creating event network-vif-plugged:7f926d08-fc86-4232-a70c-16322f636aa5 for instance 7dce7006-cd1a-47c6-8277-069dd009e5e6 on hv-cinder-84599 Jun 22 09:40:26.615684 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-685fa9b7-30b5-4237-9313-ef721f97a4de req-af6cdf68-b055-4493-88d8-645fa0281f8e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031627 Jun 22 09:40:26.616319 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 1015/1980] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:40:27.014355 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-e24d5cba-6d45-47ea-9767-17c6f350876f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:40:27.020188 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-e24d5cba-6d45-47ea-9767-17c6f350876f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:40:27.022967 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e24d5cba-6d45-47ea-9767-17c6f350876f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:27.023428 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e24d5cba-6d45-47ea-9767-17c6f350876f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:27.024214 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e24d5cba-6d45-47ea-9767-17c6f350876f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:27.024658 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e24d5cba-6d45-47ea-9767-17c6f350876f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:27.166037 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-e24d5cba-6d45-47ea-9767-17c6f350876f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:40:27.174813 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-e24d5cba-6d45-47ea-9767-17c6f350876f tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1574 microversion: 2.1 time: 0.164356 Jun 22 09:40:27.175389 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 966/1981] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:40:27 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:40:28.193727 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-84840fa5-2dd5-4222-a08e-a06f457c66a6 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:40:28.194436 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-84840fa5-2dd5-4222-a08e-a06f457c66a6 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:40:28.201110 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-84840fa5-2dd5-4222-a08e-a06f457c66a6 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:28.201590 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-84840fa5-2dd5-4222-a08e-a06f457c66a6 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:28.202362 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-84840fa5-2dd5-4222-a08e-a06f457c66a6 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:28.202798 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-84840fa5-2dd5-4222-a08e-a06f457c66a6 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:28.342192 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-84840fa5-2dd5-4222-a08e-a06f457c66a6 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:40:28.351968 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-84840fa5-2dd5-4222-a08e-a06f457c66a6 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1574 microversion: 2.1 time: 0.163196 Jun 22 09:40:28.352578 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 1016/1982] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:40:28 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:40:29.370076 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-7601714d-9c7f-49cb-8ba9-8be08929ef8d tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:40:29.370701 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-7601714d-9c7f-49cb-8ba9-8be08929ef8d tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:40:29.378007 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7601714d-9c7f-49cb-8ba9-8be08929ef8d tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:29.378458 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7601714d-9c7f-49cb-8ba9-8be08929ef8d tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:29.379274 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7601714d-9c7f-49cb-8ba9-8be08929ef8d tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:29.379707 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-7601714d-9c7f-49cb-8ba9-8be08929ef8d tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:29.525528 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-7601714d-9c7f-49cb-8ba9-8be08929ef8d tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:40:29.535147 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-7601714d-9c7f-49cb-8ba9-8be08929ef8d tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1561 microversion: 2.1 time: 0.168795 Jun 22 09:40:29.535752 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 967/1983] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:40:29 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:40:56.779224 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e41cd28b-7afb-4662-9561-13af114bb720 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:40:56.780008 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e41cd28b-7afb-4662-9561-13af114bb720 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:40:56.782136 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_api:SELECT=5 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:40:56.783495 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG dbcounter [-] [118025] Writing DB stats nova_cell1:SELECT=22 {{(pid=118025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:40:56.789198 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e41cd28b-7afb-4662-9561-13af114bb720 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:56.794390 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e41cd28b-7afb-4662-9561-13af114bb720 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:56.794390 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e41cd28b-7afb-4662-9561-13af114bb720 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:56.794390 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e41cd28b-7afb-4662-9561-13af114bb720 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:56.806870 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.wsgi [None req-e41cd28b-7afb-4662-9561-13af114bb720 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] HTTP exception thrown: Instance b84e6922-9b60-4a6d-8836-4b07ef206590 could not be found. Jun 22 09:40:56.808573 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e41cd28b-7afb-4662-9561-13af114bb720 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Request method failure captured: Jun 22 09:40:56.808573 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: request: DELETE /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 HTTP/1.1 Jun 22 09:40:56.808573 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept: application/json Jun 22 09:40:56.808573 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept-Encoding: identity Jun 22 09:40:56.808573 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Connection: close Jun 22 09:40:56.808573 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Length: 0 Jun 22 09:40:56.808573 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Type: application/json Jun 22 09:40:56.808573 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Host: 10.222.0.16 Jun 22 09:40:56.808573 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Openstack-System-Scope: None Jun 22 09:40:56.808573 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: User-Agent: python-urllib3/1.26.9 Jun 22 09:40:56.808573 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Auth-Token: gAAAAABistmkfOwtY0Mqgvv4OFOXEqJ-XW6pJ2f84nimnN53ncl2QdYWmtjdiRm2zgxbQHXkiGOey7s4qzXWrbuoBF4DOmC2nXSKzH8o2Vj6BjbS46c0wt_ueRXzz--E9e6LsrsawIvB4hMRGF5qW0g-qUzFeOlraumTqcGCCIL_Ekz2n58lGyk Jun 22 09:40:56.808573 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Id: None Jun 22 09:40:56.808573 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Name: None Jun 22 09:40:56.808573 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Identity-Status: Confirmed Jun 22 09:40:56.808573 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Is-Admin-Project: True Jun 22 09:40:56.808573 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Id: default Jun 22 09:40:56.808573 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Name: Default Jun 22 09:40:56.808573 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Id: 175a336dc3fd44c2ae20e51b46d423e4 Jun 22 09:40:56.808573 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Name: tempest-AttachVolumeTestJSON-2143630622 Jun 22 09:40:56.808573 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Role: member,reader Jun 22 09:40:56.808573 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Roles: member,reader Jun 22 09:40:56.811125 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/175a336dc3fd44c2ae20e51b46d423e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/175a336dc3fd44c2ae20e51b46d423e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/175a336dc3fd44c2ae20e51b46d423e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_175a336dc3fd44c2ae20e51b46d423e4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:40:56.811125 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant: tempest-AttachVolumeTestJSON-2143630622 Jun 22 09:40:56.811125 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Id: 175a336dc3fd44c2ae20e51b46d423e4 Jun 22 09:40:56.811125 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2143630622 Jun 22 09:40:56.811125 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User: tempest-AttachVolumeTestJSON-2143630622-project Jun 22 09:40:56.811125 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Id: default Jun 22 09:40:56.811125 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Name: Default Jun 22 09:40:56.811125 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Id: 566b001b7a504fadb85ad04ea1be22f2 Jun 22 09:40:56.811125 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Name: tempest-AttachVolumeTestJSON-2143630622-project Jun 22 09:40:56.811125 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: method: > Jun 22 09:40:56.811125 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: exception: Instance b84e6922-9b60-4a6d-8836-4b07ef206590 could not be found. Jun 22 09:40:56.811125 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: action_args: {'id': 'b84e6922-9b60-4a6d-8836-4b07ef206590'} Jun 22 09:40:56.812485 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:40:56.812485 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:56.812485 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:40:56.812485 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:40:56.812485 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:40:56.812485 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:40:56.812485 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:40:56.812485 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:40:56.812485 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:40:56.812485 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:40:56.812485 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b84e6922-9b60-4a6d-8836-4b07ef206590 could not be found. Jun 22 09:40:56.812485 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:56.812485 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:40:56.812485 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:56.812485 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:56.812485 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:40:56.812485 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:40:56.812485 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:40:56.812485 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:40:56.812485 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:40:56.818346 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:40:56.818346 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 09:40:56.818346 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 09:40:56.818346 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 09:40:56.818346 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 09:40:56.818346 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:40:56.818346 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:40:56.818346 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:40:56.818346 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:40:56.818346 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b84e6922-9b60-4a6d-8836-4b07ef206590 could not be found. Jun 22 09:40:56.818346 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:56.818346 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:40:56.818346 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:56.818346 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:56.818346 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:40:56.818346 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:40:56.818346 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:40:56.818346 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:40:56.818346 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b84e6922-9b60-4a6d-8836-4b07ef206590 could not be found. Jun 22 09:40:56.818346 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:40:56.820934 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e41cd28b-7afb-4662-9561-13af114bb720 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Returning 404 to user: Instance b84e6922-9b60-4a6d-8836-4b07ef206590 could not be found. {{(pid=118025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:40:56.820934 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e41cd28b-7afb-4662-9561-13af114bb720 tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 404 len: 111 microversion: 2.1 time: 0.036484 Jun 22 09:40:56.820934 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 1017/1984] 10.222.0.16 () {58 vars in 1238 bytes} [Wed Jun 22 09:40:56 2022] DELETE /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:40:56.821325 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a4ad096c-6fdb-46a8-a562-362073576fcf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:40:56.821325 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-a4ad096c-6fdb-46a8-a562-362073576fcf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] [instance: b84e6922-9b60-4a6d-8836-4b07ef206590] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:40:56.825435 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_api:SELECT=5 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:40:56.826117 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG dbcounter [-] [118024] Writing DB stats nova_cell1:SELECT=19 {{(pid=118024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:40:56.828017 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a4ad096c-6fdb-46a8-a562-362073576fcf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:56.828480 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a4ad096c-6fdb-46a8-a562-362073576fcf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:56.829291 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a4ad096c-6fdb-46a8-a562-362073576fcf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:40:56.829762 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-a4ad096c-6fdb-46a8-a562-362073576fcf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:40:56.844317 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.wsgi [None req-a4ad096c-6fdb-46a8-a562-362073576fcf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] HTTP exception thrown: Instance b84e6922-9b60-4a6d-8836-4b07ef206590 could not be found. Jun 22 09:40:56.846405 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a4ad096c-6fdb-46a8-a562-362073576fcf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Request method failure captured: Jun 22 09:40:56.846405 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: request: GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 HTTP/1.1 Jun 22 09:40:56.846405 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept: application/json Jun 22 09:40:56.846405 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Accept-Encoding: identity Jun 22 09:40:56.846405 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Connection: close Jun 22 09:40:56.846405 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Length: 0 Jun 22 09:40:56.846405 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Content-Type: application/json Jun 22 09:40:56.846405 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Host: 10.222.0.16 Jun 22 09:40:56.846405 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Openstack-System-Scope: None Jun 22 09:40:56.846405 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: User-Agent: python-urllib3/1.26.9 Jun 22 09:40:56.846405 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Auth-Token: gAAAAABistmkfOwtY0Mqgvv4OFOXEqJ-XW6pJ2f84nimnN53ncl2QdYWmtjdiRm2zgxbQHXkiGOey7s4qzXWrbuoBF4DOmC2nXSKzH8o2Vj6BjbS46c0wt_ueRXzz--E9e6LsrsawIvB4hMRGF5qW0g-qUzFeOlraumTqcGCCIL_Ekz2n58lGyk Jun 22 09:40:56.846405 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Id: None Jun 22 09:40:56.846405 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Domain-Name: None Jun 22 09:40:56.846405 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Identity-Status: Confirmed Jun 22 09:40:56.846405 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Is-Admin-Project: True Jun 22 09:40:56.846405 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Id: default Jun 22 09:40:56.846405 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Domain-Name: Default Jun 22 09:40:56.846405 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Id: 175a336dc3fd44c2ae20e51b46d423e4 Jun 22 09:40:56.846405 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Project-Name: tempest-AttachVolumeTestJSON-2143630622 Jun 22 09:40:56.846405 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Role: member,reader Jun 22 09:40:56.846405 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Roles: member,reader Jun 22 09:40:56.848557 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/175a336dc3fd44c2ae20e51b46d423e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/175a336dc3fd44c2ae20e51b46d423e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/175a336dc3fd44c2ae20e51b46d423e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_175a336dc3fd44c2ae20e51b46d423e4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:40:56.848557 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant: tempest-AttachVolumeTestJSON-2143630622 Jun 22 09:40:56.848557 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Id: 175a336dc3fd44c2ae20e51b46d423e4 Jun 22 09:40:56.848557 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2143630622 Jun 22 09:40:56.848557 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User: tempest-AttachVolumeTestJSON-2143630622-project Jun 22 09:40:56.848557 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Id: default Jun 22 09:40:56.848557 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Domain-Name: Default Jun 22 09:40:56.848557 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Id: 566b001b7a504fadb85ad04ea1be22f2 Jun 22 09:40:56.848557 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: X-User-Name: tempest-AttachVolumeTestJSON-2143630622-project Jun 22 09:40:56.848557 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: method: > Jun 22 09:40:56.848557 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: exception: Instance b84e6922-9b60-4a6d-8836-4b07ef206590 could not be found. Jun 22 09:40:56.848557 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: action_args: {'id': 'b84e6922-9b60-4a6d-8836-4b07ef206590'} Jun 22 09:40:56.849957 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:40:56.849957 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:56.849957 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:40:56.849957 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:40:56.849957 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:40:56.849957 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:40:56.849957 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:40:56.849957 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:40:56.849957 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:40:56.849957 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:40:56.849957 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b84e6922-9b60-4a6d-8836-4b07ef206590 could not be found. Jun 22 09:40:56.849957 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:56.849957 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:40:56.849957 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:56.849957 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:56.849957 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:40:56.849957 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:40:56.849957 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:40:56.849957 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:40:56.849957 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:40:56.852014 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:40:56.852014 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:40:56.852014 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:40:56.852014 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:40:56.852014 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:40:56.852014 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:40:56.852014 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:40:56.852014 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b84e6922-9b60-4a6d-8836-4b07ef206590 could not be found. Jun 22 09:40:56.852014 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:56.852014 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:40:56.852014 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:56.852014 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:40:56.852014 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:40:56.852014 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:40:56.852014 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:40:56.852014 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:40:56.852014 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b84e6922-9b60-4a6d-8836-4b07ef206590 could not be found. Jun 22 09:40:56.852014 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: ERROR nova.api.openstack.wsgi Jun 22 09:40:56.854094 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-a4ad096c-6fdb-46a8-a562-362073576fcf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] Returning 404 to user: Instance b84e6922-9b60-4a6d-8836-4b07ef206590 could not be found. {{(pid=118024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:40:56.854094 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-a4ad096c-6fdb-46a8-a562-362073576fcf tempest-AttachVolumeTestJSON-2143630622 tempest-AttachVolumeTestJSON-2143630622-project] 10.222.0.16 "GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590" status: 404 len: 111 microversion: 2.1 time: 0.032767 Jun 22 09:40:56.854094 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 968/1985] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:40:56 2022] GET /compute/v2.1/servers/b84e6922-9b60-4a6d-8836-4b07ef206590 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 09:41:14.416281 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:41:14.417353 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Wed Jun 22 09:41:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:42:23.625598 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR oslo.messaging._drivers.impl_rabbit [-] [464973eb-4c05-4793-ab21-ab2184288628] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 22 09:42:23.629900 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e245fff3-885e-4e96-b128-238c66330e73 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:42:23.630409 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e245fff3-885e-4e96-b128-238c66330e73 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:42:23.638845 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e245fff3-885e-4e96-b128-238c66330e73 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:42:23.639301 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e245fff3-885e-4e96-b128-238c66330e73 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:42:23.640087 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e245fff3-885e-4e96-b128-238c66330e73 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:42:23.640536 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e245fff3-885e-4e96-b128-238c66330e73 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:42:23.669238 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e245fff3-885e-4e96-b128-238c66330e73 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Going to try to terminate instance {{(pid=118025) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:42:23.770620 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [req-93df50ca-ac31-4c80-a97f-7de17f3f275c req-368d5987-3c7f-44e4-a8f0-43cb79fb03fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dce7006-cd1a-47c6-8277-069dd009e5e6", "tag": "7f926d08-fc86-4232-a70c-16322f636aa5"}]} {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:42:23.780605 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-93df50ca-ac31-4c80-a97f-7de17f3f275c req-368d5987-3c7f-44e4-a8f0-43cb79fb03fc service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:42:23.781081 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [req-93df50ca-ac31-4c80-a97f-7de17f3f275c req-368d5987-3c7f-44e4-a8f0-43cb79fb03fc service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:42:23.793966 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.compute.server_external_events [req-93df50ca-ac31-4c80-a97f-7de17f3f275c req-368d5987-3c7f-44e4-a8f0-43cb79fb03fc service nova] Creating event network-changed:7f926d08-fc86-4232-a70c-16322f636aa5 for instance 7dce7006-cd1a-47c6-8277-069dd009e5e6 on hv-cinder-84599 Jun 22 09:42:23.800651 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [req-93df50ca-ac31-4c80-a97f-7de17f3f275c req-368d5987-3c7f-44e4-a8f0-43cb79fb03fc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174236 Jun 22 09:42:23.801281 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 969/1986] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:42:23.979799 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e245fff3-885e-4e96-b128-238c66330e73 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 204 len: 0 microversion: 2.1 time: 0.357013 Jun 22 09:42:23.984409 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 1018/1987] 10.222.0.16 () {58 vars in 1238 bytes} [Wed Jun 22 09:42:23 2022] DELETE /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:42:23.990349 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-416845dd-bd42-4d37-8413-9ca387591ff7 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:42:23.991291 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-416845dd-bd42-4d37-8413-9ca387591ff7 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:42:23.997909 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-416845dd-bd42-4d37-8413-9ca387591ff7 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:42:23.998582 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-416845dd-bd42-4d37-8413-9ca387591ff7 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:42:23.999979 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-416845dd-bd42-4d37-8413-9ca387591ff7 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:42:24.000496 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-416845dd-bd42-4d37-8413-9ca387591ff7 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:42:24.141543 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-416845dd-bd42-4d37-8413-9ca387591ff7 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:42:24.149044 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-416845dd-bd42-4d37-8413-9ca387591ff7 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1567 microversion: 2.1 time: 0.163300 Jun 22 09:42:24.149602 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 970/1988] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:42:23 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:42:25.168413 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-e6f9f593-6a07-4c8b-8caf-b58026d7b7d7 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:42:25.169151 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-e6f9f593-6a07-4c8b-8caf-b58026d7b7d7 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:42:25.177388 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e6f9f593-6a07-4c8b-8caf-b58026d7b7d7 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:42:25.179646 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e6f9f593-6a07-4c8b-8caf-b58026d7b7d7 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:42:25.179646 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e6f9f593-6a07-4c8b-8caf-b58026d7b7d7 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:42:25.179646 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-e6f9f593-6a07-4c8b-8caf-b58026d7b7d7 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:42:25.195701 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO oslo.messaging._drivers.impl_rabbit [-] [464973eb-4c05-4793-ab21-ab2184288628] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 50090. Jun 22 09:42:25.317215 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.policy [None req-e6f9f593-6a07-4c8b-8caf-b58026d7b7d7 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118025) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:42:25.325227 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-e6f9f593-6a07-4c8b-8caf-b58026d7b7d7 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1567 microversion: 2.1 time: 0.160977 Jun 22 09:42:25.326604 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 1019/1989] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:42:25 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:42:26.345415 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-e649f967-0f98-4c67-90b2-35e922999cd5 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:42:26.346289 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-e649f967-0f98-4c67-90b2-35e922999cd5 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:42:26.354102 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e649f967-0f98-4c67-90b2-35e922999cd5 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:42:26.355188 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e649f967-0f98-4c67-90b2-35e922999cd5 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:42:26.356413 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e649f967-0f98-4c67-90b2-35e922999cd5 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:42:26.357142 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-e649f967-0f98-4c67-90b2-35e922999cd5 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:42:26.498264 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-e649f967-0f98-4c67-90b2-35e922999cd5 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:42:26.507662 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-e649f967-0f98-4c67-90b2-35e922999cd5 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1449 microversion: 2.1 time: 0.168122 Jun 22 09:42:26.513846 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 971/1990] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:42:26 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1449 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:42:26.549208 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [req-93e76608-4916-4d61-bcc0-3096c8f185fc req-ea760483-0305-43a3-b4ee-e5d78a2a65a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dce7006-cd1a-47c6-8277-069dd009e5e6", "name": "network-vif-deleted", "tag": "7f926d08-fc86-4232-a70c-16322f636aa5"}]} {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:42:26.557823 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-93e76608-4916-4d61-bcc0-3096c8f185fc req-ea760483-0305-43a3-b4ee-e5d78a2a65a2 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:42:26.558272 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [req-93e76608-4916-4d61-bcc0-3096c8f185fc req-ea760483-0305-43a3-b4ee-e5d78a2a65a2 service nova] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:42:26.571697 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.compute.server_external_events [req-93e76608-4916-4d61-bcc0-3096c8f185fc req-ea760483-0305-43a3-b4ee-e5d78a2a65a2 service nova] Creating event network-vif-deleted:7f926d08-fc86-4232-a70c-16322f636aa5 for instance 7dce7006-cd1a-47c6-8277-069dd009e5e6 on hv-cinder-84599 Jun 22 09:42:26.577688 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [req-93e76608-4916-4d61-bcc0-3096c8f185fc req-ea760483-0305-43a3-b4ee-e5d78a2a65a2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032042 Jun 22 09:42:26.578311 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 1020/1991] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Jun 22 09:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:42:27.525605 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-0fbcb8ed-40cd-46af-a842-a3ec4fd35d3e tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:42:27.526221 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.compute.api [None req-0fbcb8ed-40cd-46af-a842-a3ec4fd35d3e tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118024) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:42:27.533590 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0fbcb8ed-40cd-46af-a842-a3ec4fd35d3e tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:42:27.534042 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0fbcb8ed-40cd-46af-a842-a3ec4fd35d3e tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:42:27.534808 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0fbcb8ed-40cd-46af-a842-a3ec4fd35d3e tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:42:27.535244 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG oslo_concurrency.lockutils [None req-0fbcb8ed-40cd-46af-a842-a3ec4fd35d3e tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:42:27.601273 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.policy [None req-0fbcb8ed-40cd-46af-a842-a3ec4fd35d3e tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5526efb1bcac430daea4414450f27a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bb6b50eb7c4d89908ad40e63573977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118024) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:42:27.610613 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-0fbcb8ed-40cd-46af-a842-a3ec4fd35d3e tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 200 len: 1220 microversion: 2.1 time: 0.088902 Jun 22 09:42:27.611183 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 972/1992] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:42:27 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:42:28.629509 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-056cc428-ef3c-47ec-a741-74cf752cc640 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '>' {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:42:28.630200 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.compute.api [None req-056cc428-ef3c-47ec-a741-74cf752cc640 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] [instance: 7dce7006-cd1a-47c6-8277-069dd009e5e6] Fetching instance by UUID {{(pid=118025) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:42:28.636722 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-056cc428-ef3c-47ec-a741-74cf752cc640 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:42:28.637204 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-056cc428-ef3c-47ec-a741-74cf752cc640 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:42:28.637958 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-056cc428-ef3c-47ec-a741-74cf752cc640 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:42:28.639073 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG oslo_concurrency.lockutils [None req-056cc428-ef3c-47ec-a741-74cf752cc640 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Lock "5ad901b7-3900-406f-b273-6ca9cc1c0d47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:42:28.652923 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.wsgi [None req-056cc428-ef3c-47ec-a741-74cf752cc640 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] HTTP exception thrown: Instance 7dce7006-cd1a-47c6-8277-069dd009e5e6 could not be found. Jun 22 09:42:28.655754 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-056cc428-ef3c-47ec-a741-74cf752cc640 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Request method failure captured: Jun 22 09:42:28.655754 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: request: GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 HTTP/1.1 Jun 22 09:42:28.655754 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept: application/json Jun 22 09:42:28.655754 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Accept-Encoding: identity Jun 22 09:42:28.655754 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Connection: close Jun 22 09:42:28.655754 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Length: 0 Jun 22 09:42:28.655754 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Content-Type: application/json Jun 22 09:42:28.655754 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Host: 10.222.0.16 Jun 22 09:42:28.655754 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Openstack-System-Scope: None Jun 22 09:42:28.655754 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: User-Agent: python-urllib3/1.26.9 Jun 22 09:42:28.655754 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Auth-Token: gAAAAABisuKkqXUxWSzcoUPgPXF_baWY6DR4eMVGDZK1dvR9HRN4SBLSMgvC_JONw2yioWIxh5b6BV42Oxw5LITjFxWIO5KDpSFA_qQv_PstS1g9XssE1ui0kWaSKV7v6OLRs3w2Obmjspqg2DqmlHNo1bltip3eXTwGj3t_XnzKjYyNUivCHqk Jun 22 09:42:28.655754 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Id: None Jun 22 09:42:28.655754 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Domain-Name: None Jun 22 09:42:28.655754 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Identity-Status: Confirmed Jun 22 09:42:28.655754 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Is-Admin-Project: True Jun 22 09:42:28.655754 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Id: default Jun 22 09:42:28.655754 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Domain-Name: Default Jun 22 09:42:28.655754 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Id: d1bb6b50eb7c4d89908ad40e63573977 Jun 22 09:42:28.655754 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Project-Name: tempest-TestShelveInstance-1611913708 Jun 22 09:42:28.655754 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Role: member,reader Jun 22 09:42:28.655754 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Roles: member,reader Jun 22 09:42:28.657392 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d1bb6b50eb7c4d89908ad40e63573977"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d1bb6b50eb7c4d89908ad40e63573977"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d1bb6b50eb7c4d89908ad40e63573977"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d1bb6b50eb7c4d89908ad40e63573977", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Jun 22 09:42:28.657392 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant: tempest-TestShelveInstance-1611913708 Jun 22 09:42:28.657392 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Id: d1bb6b50eb7c4d89908ad40e63573977 Jun 22 09:42:28.657392 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-Tenant-Name: tempest-TestShelveInstance-1611913708 Jun 22 09:42:28.657392 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User: tempest-TestShelveInstance-1611913708-project Jun 22 09:42:28.657392 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Id: default Jun 22 09:42:28.657392 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Domain-Name: Default Jun 22 09:42:28.657392 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Id: 5526efb1bcac430daea4414450f27a8b Jun 22 09:42:28.657392 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: X-User-Name: tempest-TestShelveInstance-1611913708-project Jun 22 09:42:28.657392 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: method: > Jun 22 09:42:28.657392 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: exception: Instance 7dce7006-cd1a-47c6-8277-069dd009e5e6 could not be found. Jun 22 09:42:28.657392 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: action_args: {'id': '7dce7006-cd1a-47c6-8277-069dd009e5e6'} Jun 22 09:42:28.658528 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: {{(pid=118025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:42:28.658528 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:42:28.658528 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:42:28.658528 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:42:28.658528 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:42:28.658528 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:42:28.658528 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:42:28.658528 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:42:28.658528 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:42:28.658528 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:42:28.658528 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dce7006-cd1a-47c6-8277-069dd009e5e6 could not be found. Jun 22 09:42:28.658528 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:42:28.658528 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:42:28.658528 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:42:28.658528 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:42:28.658528 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:42:28.658528 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:42:28.658528 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:42:28.658528 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:42:28.658528 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:42:28.660072 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:42:28.660072 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:42:28.660072 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:42:28.660072 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:42:28.660072 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:42:28.660072 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:42:28.660072 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:42:28.660072 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dce7006-cd1a-47c6-8277-069dd009e5e6 could not be found. Jun 22 09:42:28.660072 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:42:28.660072 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:42:28.660072 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:42:28.660072 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:42:28.660072 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:42:28.660072 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:42:28.660072 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:42:28.660072 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:42:28.660072 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dce7006-cd1a-47c6-8277-069dd009e5e6 could not be found. Jun 22 09:42:28.660072 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: ERROR nova.api.openstack.wsgi Jun 22 09:42:28.661369 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: DEBUG nova.api.openstack.wsgi [None req-056cc428-ef3c-47ec-a741-74cf752cc640 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Returning 404 to user: Instance 7dce7006-cd1a-47c6-8277-069dd009e5e6 could not be found. {{(pid=118025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:42:28.661369 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO nova.api.openstack.requestlog [None req-056cc428-ef3c-47ec-a741-74cf752cc640 tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6" status: 404 len: 111 microversion: 2.1 time: 0.033044 Jun 22 09:42:28.661369 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: [pid: 118025|app: 0|req: 1021/1993] 10.222.0.16 () {58 vars in 1235 bytes} [Wed Jun 22 09:42:28 2022] GET /compute/v2.1/servers/7dce7006-cd1a-47c6-8277-069dd009e5e6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:42:28.953338 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: DEBUG nova.api.openstack.wsgi [None req-555f7cb6-99e8-4bc6-9fc7-7aa2c96ad26d tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] Calling method '.version_select at 0x7f5756d0b3a0>' {{(pid=118024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:42:29.084211 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO nova.api.openstack.requestlog [None req-555f7cb6-99e8-4bc6-9fc7-7aa2c96ad26d tempest-TestShelveInstance-1611913708 tempest-TestShelveInstance-1611913708-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2000839962" status: 202 len: 0 microversion: 2.1 time: 0.140971 Jun 22 09:42:29.084803 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: [pid: 118024|app: 0|req: 973/1994] 10.222.0.16 () {58 vars in 1253 bytes} [Wed Jun 22 09:42:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2000839962 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:43:13.344849 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:43:13.345477 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Wed Jun 22 09:43:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:43:17.170465 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:43:17.171054 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Wed Jun 22 09:43:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:43:19.250473 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:43:19.251034 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Wed Jun 22 09:43:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:45:17.631909 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:45:17.632567 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Wed Jun 22 09:45:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:45:19.817631 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:45:19.818229 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Wed Jun 22 09:45:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:46:33.355235 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:46:33.355825 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Wed Jun 22 09:46:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:46:37.178608 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:46:37.179333 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Wed Jun 22 09:46:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:46:39.258428 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:46:39.258862 dv-cinder-845990-3-iscsi devstack@n-api.service[118025]: Wed Jun 22 09:46:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:47:54.429596 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:47:54.430193 dv-cinder-845990-3-iscsi devstack@n-api.service[118024]: Wed Jun 22 09:47:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!